00000001:02000400:3.0F:1788873515.513087:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788873534.305566:0:3510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788873536.471239:0:3570:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 448 MB/s 00000001:01000000:2.0:1788873536.721666:0:3570:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 563 MB/s 00000001:01000000:3.0:1788873536.973690:0:3570:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3146 MB/s 00000020:02000000:2.0:1788873537.790026:0:3602:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gcfd7996 00000400:02000000:0.0F:1788873538.816488:0:3617:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.120@tcp [8/256/0/180] 00008000:02000000:2.0:1788873542.765423:0:3766:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788873614.220841:0:5737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788873628.658734:0:6488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788873628.658741:0:6488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788873628.658742:0:6488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788873628.658881:0:6488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000071c33110 00000080:02000400:3.0:1788873628.658892:0:6488:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788873628.670634:0:6488:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788873628.670649:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788873628.670776:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f0dc29a8) 00000020:00000080:3.0:1788873628.670797:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788873628.747197:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788873628.747611:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788873628.777082:0:6488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788873628.779639:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788873628.779650:0:6488:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788873628.779663:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b0ea 00000020:01000004:0.0:1788873628.779670:0:6488:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788873628.779675:0:6488:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788873628.779680:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000071c33110 from MGS 00000020:01000004:0.0:1788873628.779684:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788873628.779704:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c1ff5f52) 00000020:00000080:0.0:1788873628.779718:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788873628.779805:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071c33110 from MGS, refs=2 00080000:01000000:0.0:1788873628.779811:0:6488:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788873628.779816:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b0f8 00000100:00100000:0.0:1788873628.779928:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788873628.780081:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788873628.780087:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788873628.780878:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788873628.780891:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788873628.781796:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788873628.782383:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788873628.782391:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788873628.788082:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788873628.788094:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788873628.789632:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788873628.789642:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1788873628.793817:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873628.793827:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873628.793829:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873628.796199:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873628.796228:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873628.796231:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873628.796875:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788873628.798362:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788873629.047187:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3163 MB/s 00000001:01000000:3.0:1788873629.297402:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3743 MB/s 00000001:01000000:2.0:1788873629.549129:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 641 MB/s 00000001:01000000:3.0:1788873629.799268:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 796 MB/s 00080000:10000000:3.0:1788873629.805767:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1788873629.806646:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788873629.826573:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788873629.827706:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788873629.827888:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788873629.827948:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788873629.828621:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788873629.828649:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788873629.832170:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873629.832693:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788873629.832701:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788873629.840535:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788873629.840550:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788873629.842360:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788873629.842372:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788873629.844498:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788873629.844524:0:6488:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.120@tcp' 00000020:01000004:1.0:1788873629.844526:0:6488:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788873629.844577:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.120@tcp (typ=mgc) 00000020:00000080:1.0:1788873629.844600:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.120@tcp (00000000e4f11e37) 00000020:00000080:1.0:1788873629.844616:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788873629.844775:0:6488:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000019223343@MGC192.168.202.120@tcp: add connection 192.168.202.120@tcp at head 00010000:00010000:1.0:1788873629.844944:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.120@tcp-0 is initialized 00000040:01000000:1.0:1788873629.844951:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788873629.845474:0:6507:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788873629.846338:0:6508:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788873629.846380:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.120@tcp (uuid 7574ef44-222c-4adf-9b21-6aa184f7ffdf) 00000020:00000080:1.0:1788873629.846412:0:6488:0:(genops.c:1385:class_connect()) connect: client 7574ef44-222c-4adf-9b21-6aa184f7ffdf, cookie 0x25c660afb0a9b106 00000100:00080000:1.0:1788873629.846422:0:6488:0:(import.c:545:import_select_connection()) MGC192.168.202.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873629.846428:0:6488:0:(import.c:665:import_select_connection()) MGC192.168.202.120@tcp: import 0000000019223343 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873629.846475:0:6488:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e177312a x1875769858982016/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873629.846513:0:6488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS 00000020:01000004:1.0:1788873629.846531:0:6488:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788873629.846535:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788873629.846547:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009ebd8328) 00000020:00000080:1.0:1788873629.846557:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788873629.849794:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e177312a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769858982016:0@lo:250: 00000100:00100000:3.0:1788873629.855322:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873629.857885:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982016 00000100:00100000:0.0:1788873629.857900:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982016 00000100:00100000:0.0:1788873629.857946:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873629.857953:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e6d4837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3632:x1875769858982016:12345-0@lo:250: 00010000:00080000:0.0:1788873629.858007:0:6503:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7574ef44-222c-4adf-9b21-6aa184f7ffdf@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1788873629.858033:0:6503:0:(genops.c:1385:class_connect()) connect: client 7574ef44-222c-4adf-9b21-6aa184f7ffdf, cookie 0x25c660afb0a9b114 00000100:00080000:0.0:1788873629.858197:0:6503:0:(import.c:65:import_set_state_nolock()) 000000008eff424e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873629.858311:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e6d4837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:3632:x1875769858982016:12345-0@lo:250: Request processed in 356us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873629.858319:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873629.858619:0:3632:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788873629.858628:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1788873629.858635:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788873629.858640:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788873629.858642:0:3632:0:(import.c:65:import_set_state_nolock()) 0000000019223343 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788873629.858645:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788873629.858659:0:3632:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788873629.858664:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e177312a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769858982016:0@lo:250: 00000100:00100000:1.0:1788873629.869548:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873629.869779:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788873629.869787:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788873629.873380:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788873629.878282:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788873629.896839:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788873629.896857:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788873629.898311:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873629.898493:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788873629.898499:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788873629.899902:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788873629.899913:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788873630.009888:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873630.010569:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788873630.010578:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788873630.016042:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788873630.016074:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788873630.017031:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873630.017422:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788873630.017429:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788873630.018742:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788873630.018753:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788873630.019879:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873630.020165:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788873630.020172:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788873630.030192:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788873630.030469:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788873630.032854:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788873630.033146:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788873630.033153:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788873630.034506:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788873630.034526:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788873630.065092:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873630.065504:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788873630.065511:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788873630.068847:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788873630.068862:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788873630.071661:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788873630.071682:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788873630.077173:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788873630.077424:0:6488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788873630.077432:0:6488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788873630.077632:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788873630.077751:0:6488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.120@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788873630.077757:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788873630.077759:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788873630.077760:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873630.077761:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873630.077762:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873630.077764:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873630.077765:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873630.077767:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788873630.077768:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788873630.077769:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788873630.077771:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873630.077772:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788873630.077775:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788873630.077777:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788873630.077779:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788873630.077785:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873630.077786:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873630.077787:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873630.077788:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873630.077788:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873630.077789:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788873630.077790:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788873630.077791:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788873630.077792:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873630.077792:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788873630.077839:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788873630.077858:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b7ee87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982144:0@lo:253: 00000100:00100000:0.0:1788873630.077933:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.078061:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b22544d0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.079184:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982144 00000100:00100000:1.0:1788873630.079194:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982144 00000100:00100000:1.0:1788873630.079403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788873630.079412:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce72d7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6488:x1875769858982144:12345-0@lo:253: 20000000:01000000:1.0:1788873630.079477:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788873630.079481:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788873630.082252:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788873630.082512:0:6506:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788873630.082852:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873630.084792:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788873630.085062:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788873630.085068:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788873630.085074:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788873630.085077:0:6506:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788873630.085089:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788873630.085470:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873630.086110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788873630.086127:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788873630.086159:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788873630.086174:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788873630.086188:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788873630.086298:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788873630.086307:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788873630.086319:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788873630.086324:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788873630.086347:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788873630.086353:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788873630.086367:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788873630.086393:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788873630.086426:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788873630.086431:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788873630.086438:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873630.086541:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788873630.086551:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788873630.086566:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788873630.086580:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788873630.086594:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788873630.086601:0:6506:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788873630.086626:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788873630.086634:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788873630.086645:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788873630.086659:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788873630.086689:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788873630.086698:0:6506:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788873630.086735:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788873630.086744:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788873630.086757:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788873630.086772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788873630.086848:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788873630.086870:0:6506:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788873630.086877:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788873630.091646:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788873630.092000:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788873630.092025:0:6506:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.120@tcp for mdt 20000000:01000000:0.0:1788873630.092027:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788873630.092042:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788873630.092048:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788873630.092061:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788873630.092065:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:0.0:1788873630.092077:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788873630.092083:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788873630.092096:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788873630.092110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788873630.092138:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788873630.092141:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788873630.092145:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788873630.092187:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788873630.092189:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788873630.093602:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788873630.093863:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788873630.093890:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788873630.093904:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788873630.093915:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788873630.093923:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788873630.094246:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788873630.094495:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788873630.094516:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788873630.094533:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788873630.094543:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788873630.094545:0:6506:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788873630.094550:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788873630.094552:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788873630.094558:0:6506:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788873630.094565:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788873630.094898:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788873630.094996:0:6506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788873630.112814:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788873630.112858:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788873630.114110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788873630.114158:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788873630.114182:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114199:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114284:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114291:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114298:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114303:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114317:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fa9acd0 already unused, calling callback (00000000356f5322) 00010000:00010000:0.0:1788873630.114325:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114333:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114347:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114354:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.114360:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008fa9acd0/0x25c660afb0a9b11b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788873630.114377:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788873630.134578:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce72d7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6488:x1875769858982144:12345-0@lo:253: Request processed in 55158us (56636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.134604:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873630.134698:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b7ee87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982144:0@lo:253: 10000000:01000000:0.0:1788873630.134715:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788873630.134718:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788873630.134720:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788873630.134721:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873630.134722:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788873630.134724:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873630.134725:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873630.134726:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873630.134727:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788873630.134729:0:6488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788873630.134730:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873630.134732:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788873630.134752:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000071c33110 from lustre-MDT0000 10000000:01000000:0.0:1788873630.134786:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788873630.134795:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788873630.134800:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d3480da19c0 10000000:01000000:0.0:1788873630.134804:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873630.134812:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3480da19c0 from 1 10000000:01000000:0.0:1788873630.134815:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788873630.134852:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.134862:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.134871:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873630.134963:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b7ee87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982272:0@lo:101: 00000100:00100000:0.0:1788873630.135001:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.135104:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d81cd6a4 going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.135186:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982272 00000100:00100000:2.0:1788873630.135193:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982272 00000100:00100000:2.0:1788873630.135446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873630.135454:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e948b2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6488:x1875769858982272:12345-0@lo:101: 00010000:00010000:2.0:1788873630.135477:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873630.135489:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b122 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.135511:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.135529:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.135538:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f637364a, rc 0) 00000100:00100000:2.0:1788873630.135585:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e948b2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6488:x1875769858982272:12345-0@lo:101: Request processed in 132us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.135591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873630.135729:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b7ee87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982272:0@lo:101: 00010000:00010000:1.0:1788873630.135744:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.135752:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.135809:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982400:0@lo:501: 00000100:00100000:1.0:1788873630.135836:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.135865:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c4d10ea going to sleep for 11 seconds 00000100:00100000:0.0:1788873630.136025:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982400 00000100:00100000:0.0:1788873630.136030:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982400 00000100:00100000:0.0:1788873630.136055:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873630.136060:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf7870fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6488:x1875769858982400:12345-0@lo:501: 00000100:00100000:0.0:1788873630.136146:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf7870fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6488:x1875769858982400:12345-0@lo:501: Request processed in 85us (309us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788873630.136152:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788873630.136274:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982400:0@lo:501: 10000000:01000000:1.0:1788873630.136303:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788873630.136321:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.136329:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873630.136337:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d34473c7800 10000000:01000000:1.0:1788873630.136342:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788873630.136345:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d34473c7800 10000000:01000000:1.0:1788873630.136347:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788873630.136350:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d34473c7800 from 1 10000000:01000000:1.0:1788873630.136352:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788873630.136370:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.136400:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.136408:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.136421:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982528:0@lo:101: 00000100:00100000:1.0:1788873630.136446:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.136457:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c4d10ea going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.136577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982528 00000100:00100000:2.0:1788873630.136581:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982528 00000100:00100000:2.0:1788873630.136600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788873630.136605:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b5219b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6488:x1875769858982528:12345-0@lo:101: 00010000:00010000:2.0:1788873630.136613:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873630.136623:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d97ab5f8/0x25c660afb0a9b137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b130 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.136638:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d97ab5f8/0x25c660afb0a9b137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b130 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.136645:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d97ab5f8/0x25c660afb0a9b137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b130 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.136653:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d97ab5f8, rc 0) 00000100:00100000:2.0:1788873630.136689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b5219b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6488:x1875769858982528:12345-0@lo:101: Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.136695:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788873630.136981:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982528:0@lo:101: 00010000:00010000:1.0:1788873630.136992:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.136999:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873630.137009:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788873630.137023:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.137029:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000006c303a01/0x25c660afb0a9b130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873630.137035:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788873630.137040:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788873630.137044:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d34473c7800 10000000:01000000:1.0:1788873630.137046:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788873630.137049:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788873630.137058:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788873630.137072:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.137079:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.137084:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.137095:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982656:0@lo:101: 00000100:00100000:1.0:1788873630.137122:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.137154:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c4d10ea going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.137394:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982656 00000100:00100000:2.0:1788873630.137400:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982656 00000100:00100000:2.0:1788873630.137430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788873630.137443:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b112d977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6488:x1875769858982656:12345-0@lo:101: 00010000:00010000:2.0:1788873630.137452:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873630.137536:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b13e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.137555:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.137563:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.137570:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003079f747, rc 0) 00000100:00100000:2.0:1788873630.137602:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b112d977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+8:6488:x1875769858982656:12345-0@lo:101: Request processed in 160us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.137609:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873630.137717:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982656:0@lo:101: 00010000:00010000:1.0:1788873630.137728:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.137735:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.137784:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982784:0@lo:501: 00000100:00100000:1.0:1788873630.137810:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.137827:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c4d10ea going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.137951:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982784 00000100:00100000:2.0:1788873630.137956:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982784 00000100:00100000:2.0:1788873630.137980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788873630.137985:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c58962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+8:6488:x1875769858982784:12345-0@lo:501: 00000100:00100000:2.0:1788873630.138102:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c58962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6488:x1875769858982784:12345-0@lo:501: Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.138109:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873630.138328:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982784:0@lo:501: 00000100:00100000:1.0:1788873630.138356:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982912:0@lo:503: 00000100:00100000:1.0:1788873630.138412:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.138441:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c4d10ea going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.138852:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858982912 00000100:00100000:2.0:1788873630.138857:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858982912 00000100:00100000:2.0:1788873630.138961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788873630.138968:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b58d9ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6488:x1875769858982912:12345-0@lo:503: 00000100:00100000:2.0:1788873630.139066:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b58d9ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6488:x1875769858982912:12345-0@lo:503: Request processed in 99us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.139083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873630.139281:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858982912:0@lo:503: 00000100:00100000:1.0:1788873630.139860:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6532:1875769858983040:0@lo:502: 00000100:00100000:1.0:1788873630.139980:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.140048:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000196b42de going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.140079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983040 00000100:00100000:2.0:1788873630.140084:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983040 00000100:00100000:2.0:1788873630.140379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788873630.140397:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f77392a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6532:x1875769858983040:12345-0@lo:502: 00000100:00100000:2.0:1788873630.140637:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f77392a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6532:x1875769858983040:12345-0@lo:502: Request processed in 241us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.140645:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873630.140763:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c7f2143 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6532:1875769858983040:0@lo:502: 00000020:01000000:3.0:1788873630.140798:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873630.140811:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873630.140814:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788873630.140819:0:6532:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788873630.140822:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873630.140835:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d9311cb2) 00000020:00000080:3.0:1788873630.140851:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788873630.140858:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788873630.141007:0:6532:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788873630.141015:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b153 00000020:00000080:3.0:1788873630.141368:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788873630.141374:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873630.141378:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873630.141390:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788873630.141394:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873630.141399:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873630.141400:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788873630.141403:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873630.141410:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003c1ac8c1) 00000020:00000080:3.0:1788873630.141420:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788873630.141431:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788873630.141433:0:6532:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788873630.141436:0:6532:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788873630.141442:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788873630.141576:0:6532:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071c33110 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788873630.141591:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006bb988f9) 00000020:00000080:3.0:1788873630.141609:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788873630.141668:0:6532:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788873630.141673:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b168 00000020:00000080:3.0:1788873630.141776:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788873630.141782:0:6532:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788873630.141787:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x25c660afb0a9b16f 00080000:01000000:3.0:1788873630.141791:0:6532:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788873630.141794:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b176 00080000:10000000:3.0:1788873630.142437:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788873630.142757:0:6532:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788873630.152013:0:6532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788873630.261144:0:6532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788873630.261698:0:6532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788873630.263497:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788873630.263778:0:6532:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788873630.266062:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ff6c4568) 00000020:00000080:1.0:1788873630.266084:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788873630.266159:0:6532:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788873630.266165:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b184 00000020:00000080:3.0:1788873630.266881:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788873630.271542:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.275511:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.278719:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.285147:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.288632:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.290586:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788873630.292631:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x25c660afb0a9b18b 00000020:00000080:1.0:1788873630.292917:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788873630.292930:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873630.292937:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873630.292938:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788873630.292941:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873630.292945:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873630.292946:0:6532:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788873630.292948:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788873630.292950:0:6532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788873630.292953:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873630.292955:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873630.292956:0:6532:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788873630.292958:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873630.292971:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873630.292972:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788873630.292976:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788873630.293016:0:6532:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788873630.293069:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abc9850f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6532:1875769858983168:0@lo:502: 00000100:00100000:1.0:1788873630.293146:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.293258:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067382dd1 going to sleep for 11 seconds 00000100:00100000:3.0:1788873630.293565:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983168 00000100:00100000:3.0:1788873630.293573:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983168 00000100:00100000:3.0:1788873630.293656:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873630.293666:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c877e9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6532:x1875769858983168:12345-0@lo:502: 00000100:00100000:3.0:1788873630.293813:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c877e9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6532:x1875769858983168:12345-0@lo:502: Request processed in 147us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873630.293822:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788873630.293907:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abc9850f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6532:1875769858983168:0@lo:502: 00000020:01000000:2.0:1788873630.293936:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873630.293942:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873630.293943:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788873630.293947:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788873630.294167:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788873630.294186:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788873630.294234:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.294244:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873630.294259:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34473c7800 from 1 10000000:01000000:0.0:1788873630.294262:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873630.294289:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.294296:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.294304:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873630.294318:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983296:0@lo:101: 00000100:00100000:0.0:1788873630.294356:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.294612:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000693d6350 going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.294669:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983296 00000100:00100000:1.0:1788873630.294675:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983296 00000100:00100000:1.0:1788873630.294701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788873630.294707:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5067698 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:6488:x1875769858983296:12345-0@lo:101: 00010000:00010000:1.0:1788873630.294717:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873630.294731:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b192 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.294750:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.294760:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.294767:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000212be891, rc 0) 00000100:00100000:1.0:1788873630.294810:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5067698 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:6488:x1875769858983296:12345-0@lo:101: Request processed in 103us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.294816:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788873630.294979:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983296:0@lo:101: 00010000:00010000:0.0:1788873630.294992:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.295001:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873630.295615:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983424:0@lo:256: 00000100:00100000:0.0:1788873630.295658:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.295673:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000693d6350 going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.295800:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983424 00000100:00100000:1.0:1788873630.295806:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983424 00000100:00100000:1.0:1788873630.295837:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788873630.295844:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d114d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:6488:x1875769858983424:12345-0@lo:256: 20000000:01000000:1.0:1788873630.295868:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788873630.295886:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788873630.295959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d114d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:6488:x1875769858983424:12345-0@lo:256: Request processed in 116us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.295967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788873630.296182:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983424:0@lo:256: 10000000:01000000:0.0:1788873630.296779:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788873630.296798:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.296816:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873630.296823:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34473c7800 from 1 10000000:01000000:0.0:1788873630.296826:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873630.296851:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.296858:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.296866:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873630.296893:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983552:0@lo:101: 00000100:00100000:0.0:1788873630.296932:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.296960:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000693d6350 going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.297231:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983552 00000100:00100000:1.0:1788873630.297238:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983552 00000100:00100000:1.0:1788873630.297275:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873630.297282:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060ab0dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:6488:x1875769858983552:12345-0@lo:101: 00010000:00010000:1.0:1788873630.297292:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873630.297305:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b1a0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.297324:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.297334:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.297342:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070c63fb7, rc 0) 00000100:00100000:1.0:1788873630.297391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060ab0dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858983552:12345-0@lo:101: Request processed in 98us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.297398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788873630.297558:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983552:0@lo:101: 00010000:00010000:0.0:1788873630.297570:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.297578:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873630.297633:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983680:0@lo:501: 00000100:00100000:0.0:1788873630.297658:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.297680:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000693d6350 going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.298045:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983680 00000100:00100000:1.0:1788873630.298050:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983680 00000100:00100000:1.0:1788873630.298081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788873630.298087:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7897c4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858983680:12345-0@lo:501: 00000100:00100000:1.0:1788873630.298402:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7897c4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858983680:12345-0@lo:501: Request processed in 314us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.298416:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788873630.298519:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983680:0@lo:501: 00000100:00100000:0.0:1788873630.298552:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983808:0@lo:503: 00000100:00100000:0.0:1788873630.298591:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.298644:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000693d6350 going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.298750:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983808 00000100:00100000:2.0:1788873630.298756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983808 00000100:00100000:3.0:1788873630.298801:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788873630.298810:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d7f9cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858983808:12345-0@lo:503: 00000040:00080000:3.0:1788873630.298847:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873630.298904:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d7f9cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858983808:12345-0@lo:503: Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873630.298910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873630.299045:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983808:0@lo:503: 00000040:00080000:1.0:1788873630.299955:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788873630.300157:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788873630.300178:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873630.300224:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873630.300236:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873630.300279:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788873630.300282:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d34473c7800 10000000:01000000:3.0:1788873630.300285:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d34473c7800 10000000:01000000:3.0:1788873630.300289:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788873630.300294:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34473c7800 from 1 10000000:01000000:3.0:1788873630.300297:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788873630.300339:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873630.300347:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873630.300356:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873630.300373:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983936:0@lo:101: 00000100:00100000:3.0:1788873630.300430:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873630.300458:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006f85e3d going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.300577:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858983936 00000100:00100000:1.0:1788873630.300584:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858983936 00000100:00100000:1.0:1788873630.300622:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788873630.300628:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ec6c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858983936:12345-0@lo:101: 00010000:00010000:1.0:1788873630.300640:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873630.300651:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b1ae expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.300671:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.300680:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.300688:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047986042, rc 0) 00000100:00100000:1.0:1788873630.300719:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ec6c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6488:x1875769858983936:12345-0@lo:101: Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.300725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873630.300804:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858983936:0@lo:101: 00010000:00010000:3.0:1788873630.300817:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873630.300837:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873630.300970:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858984064:0@lo:501: 00000100:00100000:3.0:1788873630.300996:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873630.301015:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006f85e3d going to sleep for 11 seconds 00000100:00100000:3.0:1788873630.301029:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984064 00000100:00100000:3.0:1788873630.301033:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984064 00000100:00100000:3.0:1788873630.301052:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873630.301058:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0dec82b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6488:x1875769858984064:12345-0@lo:501: 00000100:00100000:3.0:1788873630.301162:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0dec82b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6488:x1875769858984064:12345-0@lo:501: Request processed in 104us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873630.301168:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873630.301319:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858984064:0@lo:501: 00000100:00100000:3.0:1788873630.301344:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858984192:0@lo:503: 00000100:00100000:3.0:1788873630.301391:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873630.301519:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006f85e3d going to sleep for 11 seconds 00000100:00100000:2.0:1788873630.301599:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984192 00000100:00100000:2.0:1788873630.301604:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984192 00000100:00100000:2.0:1788873630.301624:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788873630.301630:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a319bd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6488:x1875769858984192:12345-0@lo:503: 00000100:00100000:2.0:1788873630.301715:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a319bd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6488:x1875769858984192:12345-0@lo:503: Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873630.301722:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873630.301818:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858984192:0@lo:503: 00000100:00100000:3.0:1788873630.302050:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6537:1875769858984320:0@lo:502: 00000100:00100000:3.0:1788873630.302082:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873630.302102:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 000000001174c26a going to sleep for 11 seconds 00000100:00100000:0.0:1788873630.302199:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984320 00000100:00100000:0.0:1788873630.302243:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984320 00000100:00100000:0.0:1788873630.302266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788873630.302271:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cfa46a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6537:x1875769858984320:12345-0@lo:502: 00000100:00100000:0.0:1788873630.302348:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cfa46a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6537:x1875769858984320:12345-0@lo:502: Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873630.302355:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873630.302518:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9520abc pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6537:1875769858984320:0@lo:502: 00000020:01000004:3.0:1788873630.302570:0:6537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788873630.302592:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000078c36fe4) 00000020:00000080:3.0:1788873630.302612:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788873630.302705:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071c33110 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788873630.302710:0:6537:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000071c33110 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788873630.302712:0:6537:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000071c33110 4 00010000:00080000:3.0:1788873630.302745:0:6537:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008de60394@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:0.0:1788873630.306568:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788873630.306819:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788873630.306944:0:6537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788873630.306958:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x25c660afb0a9b1c3 00000100:00080000:0.0:1788873630.306968:0:6537:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873630.306973:0:6537:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008de60394 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873630.307008:0:6537:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000951c1e30 x1875769858984448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873630.307070:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000951c1e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769858984448:0@lo:38: 00000100:00100000:3.0:1788873630.307138:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.307258:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984448 00000100:00100000:1.0:1788873630.307266:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984448 00000100:00100000:1.0:1788873630.307304:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873630.307310:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9520abc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769858984448:12345-0@lo:38: 00000100:00080000:0.0:1788873630.307392:0:6537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788873630.314034:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9520abc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769858984448:12345-0@lo:38: Request processed in 6717us (6890us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788873630.314051:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873630.314785:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031a905f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6537:1875769858984576:0@lo:502: 00000100:00100000:0.0:1788873630.314861:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873630.314982:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000693d6350 going to sleep for 11 seconds 00000100:00100000:1.0:1788873630.315035:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984576 00000100:00100000:1.0:1788873630.315043:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984576 00000100:00100000:1.0:1788873630.315093:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873630.315102:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f4041a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6537:x1875769858984576:12345-0@lo:502: 00000100:00100000:1.0:1788873630.315317:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f4041a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6537:x1875769858984576:12345-0@lo:502: Request processed in 215us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.315325:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788873630.315428:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031a905f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6537:1875769858984576:0@lo:502: 00000040:00080000:0.0:1788873630.315455:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1788873630.315631:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873630.315639:0:3632:0:(import.c:65:import_set_state_nolock()) 000000008de60394 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873630.315644:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788873630.315647:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000951c1e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769858984448:0@lo:38: 00000020:01000000:1.0:1788873630.315724:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788873630.315746:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788873630.315766:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.315776:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788873630.315821:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788873630.315823:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788873630.315824:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873630.315826:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873630.315827:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873630.315828:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873630.315829:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788873630.315830:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788873630.315832:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788873630.315833:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788873630.315835:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873630.315836:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788873630.315839:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788873630.315841:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788873630.315842:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788873630.315843:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873630.315845:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873630.315846:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873630.315846:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873630.315851:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788873630.315852:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788873630.315853:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788873630.315854:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788873630.315855:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873630.315856:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788873630.315943:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788873630.315954:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000709991eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858984704:0@lo:253: 00000100:00100000:1.0:1788873630.315990:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873630.316015:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000008bdde07c going to sleep for 11 seconds 00000100:00100000:0.0:1788873630.316119:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984704 00000100:00100000:0.0:1788873630.316133:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984704 00000100:00100000:0.0:1788873630.316172:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788873630.316178:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001db69f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6488:x1875769858984704:12345-0@lo:253: 20000000:01000000:0.0:1788873630.316313:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788873630.316326:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788873630.320608:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788873630.320656:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788873630.320758:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788873630.320766:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788873630.320790:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.320822:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.320831:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.320899:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873630.320914:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 12 pid: 6506 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873630.320931:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d616bbde pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769858984832:0@lo:104: 00000100:00100000:2.0:1788873630.320999:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873630.321057:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e1aae8b going to sleep for 11 seconds 00000100:00100000:3.0:1788873630.321247:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984832 00000100:00100000:3.0:1788873630.321255:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984832 00000100:00100000:3.0:1788873630.321306:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873630.321314:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7ab61bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769858984832:12345-0@lo:104: 00010000:00010000:3.0:1788873630.321327:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873630.321391:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788873630.321397:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7ab61bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769858984832:12345-0@lo:104: Request processed in 85us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873630.321405:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788873630.321595:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873630.321601:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.321608:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000053413310 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:1.0:1788873630.321611:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.321618:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873630.321624:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873630.321630:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873630.321665:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.321672:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873630.321685:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.321692:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 0000000053413310/0x25c660afb0a9b192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b199 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.321714:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873630.321716:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873630.321718:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873630.322284:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa4ccda1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858984960:0@lo:103: 00000100:00100000:3.0:1788873630.322325:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873630.322761:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d616bbde pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769858984832:0@lo:104: 00010000:00010000:2.0:1788873630.322780:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.322915:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858984960 00000100:00100000:1.0:1788873630.322921:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858984960 00010000:00010000:1.0:1788873630.322944:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 13 pid: 6506 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.323162:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873630.323585:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036f97da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3634:x1875769858984960:12345-0@lo:103: 00010000:00010000:1.0:1788873630.323601:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873630.323605:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 13 pid: 6506 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323616:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 13 pid: 6506 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323630:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000212be891/0x25c660afb0a9b199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b192 expref: 13 pid: 6506 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323644:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323651:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788873630.323665:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002902831s 00010000:00010000:1.0:1788873630.323669:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323687:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323692:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323698:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323704:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002bf666ba already unused, calling callback (00000000356f5322) 00010000:00010000:1.0:1788873630.323707:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323715:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323738:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873630.323748:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873630.323796:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036f97da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:3634:x1875769858984960:12345-0@lo:103: Request processed in 628us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873630.323804:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873630.323955:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001db69f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6488:x1875769858984704:12345-0@lo:253: Request processed in 7777us (7965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873630.323963:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788873630.324345:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa4ccda1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858984960:0@lo:103: 00010000:00010000:0.0:1788873630.324420:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.324429:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873630.324435:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873630.324580:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000709991eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6488:1875769858984704:0@lo:253: 10000000:01000000:1.0:1788873630.324592:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788873630.324595:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788873630.324597:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788873630.324598:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873630.324599:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873630.324601:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873630.324610:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873630.324611:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788873630.324613:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788873630.324614:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788873630.324615:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788873630.324616:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873630.324618:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788873630.324628:0:6488:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788873630.331021:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.331227:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788873630.331514:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.331681:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788873630.331896:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.332061:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788873630.333648:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.334118:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788873630.334797:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.335145:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788873630.335968:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788873630.336540:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788873630.342049:0:6488:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788873630.359517:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788873630.362553:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788873630.362702:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788873630.363161:0:6543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000004:00000080:1.0:1788873630.366144:0:6488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:2.0:1788873630.367024:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788873630.369052:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:3.0:1788873630.371465:0:6542:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788873630.371475:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788873630.371686:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873630.376711:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788873630.378232:0:6543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788873630.378313:0:6543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788873630.378318:0:6543:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788873630.378880:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788873630.378924:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788873630.379153:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788873630.379830:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788873630.381147:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788873630.381804:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788873630.382040:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788873630.382166:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788873630.382696:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788873630.382842:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788873630.383015:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788873630.383148:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788873630.383345:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788873630.383481:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788873630.383630:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788873630.383749:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788873630.383883:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788873630.384025:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788873630.384176:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788873630.384335:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788873630.385453:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788873630.386054:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788873630.386586:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788873630.386812:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788873630.387016:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788873630.387165:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788873630.387512:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788873630.387769:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788873630.387996:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788873630.388146:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788873630.388558:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788873630.388784:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788873630.389715:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788873630.389960:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788873630.390094:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788873630.390445:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788873630.390733:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788873630.394147:0:6488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788873630.394489:0:6488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcd181a27988 00100000:10000000:1.0:1788873630.394498:0:6488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788873630.395499:0:6488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788873630.395520:0:6488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788873630.395540:0:6488:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788873630.395556:0:6488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788873630.396450:0:6488:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873630.400818:0:6488:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788873630.831667:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873631.860392:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873632.879319:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873633.902325:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873634.928009:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788873635.139263:0:6788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788873635.569404:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788873635.569412:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34473c7800 from 3 10000000:01000000:3.0:1788873635.569418:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788873635.569468:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873635.569480:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873635.569490:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873635.569513:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a52877e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858985088:0@lo:101: 00000100:00100000:3.0:1788873635.569586:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873635.569678:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb1c7320 going to sleep for 11 seconds 00000100:00100000:0.0:1788873635.570346:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985088 00000100:00100000:0.0:1788873635.570355:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985088 00000100:00100000:0.0:1788873635.570410:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788873635.570418:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078e3aa7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:6508:x1875769858985088:12345-0@lo:101: 00010000:00010000:0.0:1788873635.570430:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873635.570444:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b1d1 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873635.570465:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873635.570490:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873635.570499:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000664d3857, rc 0) 00000100:00100000:0.0:1788873635.570553:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078e3aa7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6508:x1875769858985088:12345-0@lo:101: Request processed in 136us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873635.570559:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788873635.570736:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a52877e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858985088:0@lo:101: 00010000:00010000:3.0:1788873635.570751:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873635.570760:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873635.570809:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a52877e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858985216:0@lo:256: 00000100:00100000:3.0:1788873635.570853:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873635.570889:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb1c7320 going to sleep for 11 seconds 00000100:00100000:1.0:1788873635.570984:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985216 00000100:00100000:1.0:1788873635.570989:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985216 00000100:00100000:1.0:1788873635.571032:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788873635.571039:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e696b668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6508:x1875769858985216:12345-0@lo:256: 20000000:01000000:1.0:1788873635.571051:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788873635.571067:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788873635.571070:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788873635.571143:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e696b668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:6508:x1875769858985216:12345-0@lo:256: Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873635.571150:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788873635.571385:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a52877e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858985216:0@lo:256: 10000000:01000000:3.0:1788873635.571425:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873635.571434:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873635.571442:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788873635.576791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788873635.576801:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788873635.576804:0:36:0:(import.c:65:import_set_state_nolock()) 000000008de60394 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788873635.576818:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008de60394 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873635.576967:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000709991eb x1875769858985344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873635.577117:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000709991eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769858985344:0@lo:38: 00000100:00100000:2.0:1788873635.577192:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873635.577319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985344 00000100:00100000:0.0:1788873635.577335:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985344 00000100:00100000:0.0:1788873635.577374:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873635.577381:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d616bbde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769858985344:12345-0@lo:38: 00010000:00080000:0.0:1788873635.577404:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788873635.577441:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x25c660afb0a9b1df 00000004:00100000:0.0:1788873635.577484:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788873635.577635:0:6512:0:(import.c:65:import_set_state_nolock()) 0000000046f6eb09 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873635.600872:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d616bbde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875769858985344:12345-0@lo:38: Request processed in 23483us (23672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873635.600887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788873635.604892:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000709991eb x1875769858985344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873635.604924:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788873635.604932:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788873635.604937:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788873635.604941:0:3632:0:(import.c:65:import_set_state_nolock()) 000000008de60394 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788873635.604947:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000709991eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769858985344:0@lo:38: 00010000:00010000:1.0:1788873635.950345:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788873636.107708:0:6840:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873636.107923:0:6840:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788873636.975626:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873637.999564:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873639.022851:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788873639.141656:0:6942:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873639.141826:0:6942:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873640.046350:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873640.687868:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006da0dfa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769858985600:0@lo:400: 00000100:00100000:3.0:1788873640.687942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873640.688003:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873640.688009:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008020c508 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858985472:0@lo:400: 00000100:00100000:3.0:1788873640.688036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873640.688520:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985600 00000100:00100000:1.0:1788873640.688530:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985600 00000100:00100000:1.0:1788873640.688583:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873640.688592:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a52877e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769858985600:12345-0@lo:400: 00000100:00100000:1.0:1788873640.688657:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a52877e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769858985600:12345-0@lo:400: Request processed in 67us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873640.688665:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873640.688689:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985472 00000100:00100000:1.0:1788873640.688693:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985472 00000100:00100000:1.0:1788873640.688718:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788873640.688724:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a9d3367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:3636:x1875769858985472:12345-0@lo:400: 00000100:00100000:1.0:1788873640.688753:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a9d3367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:3636:x1875769858985472:12345-0@lo:400: Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873640.688759:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788873640.688845:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008020c508 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858985472:0@lo:400: 00010000:00080000:3.0:1788873640.688859:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006da0dfa0 x1875769858985600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873640.688870:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006da0dfa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769858985600:0@lo:400: 00010000:00010000:2.0:1788873641.071540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873642.095336:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873643.119967:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873644.144538:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873645.170390:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873645.806567:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005e1a186 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769858985856:0@lo:400: 00000100:00100000:3.0:1788873645.806651:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873645.806749:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873645.806754:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041f6a776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858985728:0@lo:400: 00000100:00100000:3.0:1788873645.806785:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873645.806948:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985856 00000100:00100000:0.0:1788873645.806959:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985856 00000100:00100000:0.0:1788873645.807024:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873645.807034:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027ce37bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769858985856:12345-0@lo:400: 00000100:00100000:0.0:1788873645.807099:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027ce37bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769858985856:12345-0@lo:400: Request processed in 66us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873645.807106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788873645.807269:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000005e1a186 x1875769858985856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873645.807286:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005e1a186 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769858985856:0@lo:400: 00000100:00100000:1.0:1788873645.807397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985728 00000100:00100000:1.0:1788873645.807417:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985728 00000100:00100000:1.0:1788873645.807456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788873645.807463:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a6953e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:3634:x1875769858985728:12345-0@lo:400: 00000100:00100000:1.0:1788873645.807508:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a6953e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:3634:x1875769858985728:12345-0@lo:400: Request processed in 46us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873645.807514:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788873645.807622:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041f6a776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858985728:0@lo:400: 00010000:00010000:3.0:1788873646.194035:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873647.214842:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873648.238512:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873649.263326:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788873649.380314:0:7440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788873649.380330:0:7440:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788873649.380332:0:7440:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788873649.380445:0:7440:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005845be44 00000020:01000004:0.0:1788873649.380462:0:7440:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788873649.380474:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788873649.380489:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000adc4f2a8) 00000020:00000080:0.0:1788873649.380504:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788873649.456780:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788873649.456877:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788873649.501283:0:7440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788873649.501512:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788873649.501523:0:7440:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788873649.501535:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9b1ed 00000020:01000004:3.0:1788873649.501541:0:7440:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788873649.501562:0:7440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788873649.501566:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788873649.501572:0:7440:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788873649.501599:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788873649.501603:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788873649.531498:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788873649.531542:0:7440:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.120@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788873649.531546:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788873649.531548:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788873649.531549:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873649.531551:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873649.531552:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873649.531553:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873649.531554:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788873649.531555:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788873649.531556:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788873649.531558:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873649.531559:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788873649.531562:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788873649.531564:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788873649.531565:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788873649.531567:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873649.531567:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873649.531568:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873649.531570:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873649.531570:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788873649.531572:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788873649.531573:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788873649.531574:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873649.531575:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788873649.531603:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788873649.531623:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c65e3c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858985984:0@lo:253: 00000100:00100000:3.0:1788873649.531871:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.531985:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a3be2bb going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.532357:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858985984 00000100:00100000:1.0:1788873649.532365:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858985984 00000100:00100000:1.0:1788873649.532449:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788873649.532459:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000176ea550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:7440:x1875769858985984:12345-0@lo:253: 20000000:01000000:1.0:1788873649.532487:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788873649.532492:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788873649.532496:0:6503:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788873649.532499:0:6503:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788873649.532535:0:6503:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788873649.532757:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873649.532893:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788873649.532908:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788873649.532926:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788873649.532941:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788873649.532972:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788873649.533030:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788873649.533040:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788873649.533054:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788873649.533060:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788873649.533072:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788873649.533079:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788873649.533091:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788873649.533121:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788873649.533259:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788873649.533270:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788873649.533285:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788873649.533292:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788873649.533305:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788873649.533312:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:1.0:1788873649.533324:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788873649.533329:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788873649.533340:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788873649.533357:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788873649.533370:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788873649.533449:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788873649.533459:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788873649.533471:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788873649.533488:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788873649.533504:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788873649.533510:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788873649.533521:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788873649.533540:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788873649.533546:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788873649.533567:0:6503:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788873649.533573:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788873649.534441:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788873649.534871:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788873649.534898:0:6503:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.120@tcp for mdt 20000000:01000000:1.0:1788873649.534900:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788873649.534917:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788873649.534925:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788873649.534936:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788873649.534942:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:1.0:1788873649.535069:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788873649.535079:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788873649.535090:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788873649.535106:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788873649.535152:0:6503:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788873649.535161:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788873649.535884:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788873649.536189:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788873649.536242:0:6503:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.120@tcp for mdt 20000000:01000000:1.0:1788873649.536245:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788873649.536265:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788873649.536271:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788873649.536285:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788873649.536291:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:1.0:1788873649.536303:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788873649.536310:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788873649.536322:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788873649.536339:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788873649.536361:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788873649.536364:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788873649.536368:0:6503:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788873649.536424:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788873649.536426:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788873649.536864:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788873649.536886:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788873649.536901:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788873649.537161:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788873649.537184:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788873649.537236:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788873649.537251:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788873649.537253:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788873649.537927:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788873649.538022:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788873649.538044:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788873649.538401:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788873649.538422:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788873649.538440:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788873649.538449:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788873649.538452:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788873649.538947:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788873649.539028:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788873649.539045:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788873649.539427:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788873649.539449:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788873649.539472:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788873649.539488:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788873649.539490:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788873649.539495:0:6503:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788873649.539502:0:6503:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788873649.540108:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788873649.540409:0:6503:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788873649.564438:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788873649.564577:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564608:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564615:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564642:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564650:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564714:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564735:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 12 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.564751:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9e1a1d1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769858986112:0@lo:104: 00000100:00100000:2.0:1788873649.564829:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873649.564895:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564903:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 12 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.564911:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d3d789d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769858986240:0@lo:104: 00000100:00100000:2.0:1788873649.564933:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873649.564962:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.564970:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 12 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.564977:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be9e426a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769858986368:0@lo:104: 00000100:00100000:2.0:1788873649.565008:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.565017:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006f85e3d going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.565150:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986112 00000100:00100000:0.0:1788873649.565159:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986112 00000100:00100000:0.0:1788873649.565228:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986240 00000100:00100000:0.0:1788873649.565231:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986240 00000100:00100000:0.0:1788873649.565243:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986368 00000100:00100000:0.0:1788873649.565246:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986368 00000100:00100000:0.0:1788873649.565259:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873649.565267:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c40fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6503:x1875769858986112:12345-0@lo:104: 00010000:00010000:0.0:1788873649.565281:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.565340:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873649.565346:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c40fce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6503:x1875769858986112:12345-0@lo:104: Request processed in 80us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.565352:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873649.565371:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873649.565377:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070a98c4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6503:x1875769858986240:12345-0@lo:104: 00010000:00010000:0.0:1788873649.565383:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.565434:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788873649.565439:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070a98c4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6503:x1875769858986240:12345-0@lo:104: Request processed in 64us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.565445:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873649.565457:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873649.565462:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003c7240e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6503:x1875769858986368:12345-0@lo:104: 00010000:00010000:0.0:1788873649.565468:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.565492:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788873649.565496:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003c7240e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6503:x1875769858986368:12345-0@lo:104: Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.565501:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788873649.566144:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788873649.566150:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566158:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030b3b560 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:2.0:1788873649.566160:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566167:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873649.566172:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873649.566177:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873649.566239:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566247:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873649.566269:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566275:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 0000000030b3b560/0x25c660afb0a9b1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1b5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566289:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788873649.566292:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566309:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004470e5c8 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:2.0:1788873649.566310:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566316:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873649.566320:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873649.566324:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873649.566341:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566345:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873649.566350:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566355:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 000000004470e5c8/0x25c660afb0a9b13e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b145 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566365:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873649.566367:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566372:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fa9acd0 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:2.0:1788873649.566374:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566389:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873649.566394:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873649.566398:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873649.566410:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566415:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873649.566428:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566434:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b129 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.566447:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873649.566448:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873649.566449:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873649.566464:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087c86a47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858986624:0@lo:103: 00000100:00100000:2.0:1788873649.566507:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.566543:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873649.566548:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036da5e8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858986496:0@lo:103: 00000100:00100000:2.0:1788873649.566568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.566593:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769858986752:0@lo:103: 00000100:00100000:2.0:1788873649.566613:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.566688:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986624 00000100:00100000:2.0:1788873649.566883:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986624 00010000:00010000:2.0:1788873649.566909:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 13 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.566926:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986496 00000100:00100000:2.0:1788873649.566928:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986496 00010000:00010000:2.0:1788873649.566936:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.566945:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986752 00000100:00100000:2.0:1788873649.566947:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986752 00010000:00010000:2.0:1788873649.567081:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 15 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.567097:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873649.567104:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006735f57d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3636:x1875769858986624:12345-0@lo:103: 00010000:00010000:2.0:1788873649.567116:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873649.567121:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 15 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567130:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 15 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567147:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873649.567188:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006735f57d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3636:x1875769858986624:12345-0@lo:103: Request processed in 85us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.567194:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873649.567256:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873649.567262:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd45539d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3636:x1875769858986496:12345-0@lo:103: 00010000:00010000:2.0:1788873649.567270:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873649.567281:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567289:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567298:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873649.567320:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd45539d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3636:x1875769858986496:12345-0@lo:103: Request processed in 60us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.567326:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873649.567341:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873649.567346:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a45193b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3633:x1875769858986752:12345-0@lo:103: 00010000:00010000:2.0:1788873649.567354:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873649.567356:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 13 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567363:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 13 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567372:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567379:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567393:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567399:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567404:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567415:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567421:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002bf666ba already unused, calling callback (00000000356f5322) 00010000:00010000:2.0:1788873649.567423:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567430:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567437:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567446:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873649.567473:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a45193b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3633:x1875769858986752:12345-0@lo:103: Request processed in 128us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.567479:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873649.567524:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769858986752:0@lo:103: 00010000:00010000:2.0:1788873649.567559:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047986042/0x25c660afb0a9b1b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b1ae expref: 12 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.567570:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9e1a1d1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769858986112:0@lo:104: 00010000:00010000:2.0:1788873649.567579:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003079f747/0x25c660afb0a9b145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b13e expref: 11 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.567585:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d3d789d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769858986240:0@lo:104: 00010000:00010000:2.0:1788873649.567592:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f637364a/0x25c660afb0a9b129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b122 expref: 10 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.567610:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be9e426a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769858986368:0@lo:104: 00010000:00010000:2.0:1788873649.567626:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567634:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567640:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.567645:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002bf666ba/0x25c660afb0a9b1f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788873649.567660:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788873649.567968:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036da5e8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858986496:0@lo:103: 00000100:00100000:3.0:1788873649.567977:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087c86a47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858986624:0@lo:103: 00010000:00010000:0.0:1788873649.568307:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873649.574092:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000176ea550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:7440:x1875769858985984:12345-0@lo:253: Request processed in 41625us (42211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.574112:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788873649.574260:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c65e3c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858985984:0@lo:253: 10000000:01000000:3.0:1788873649.574278:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788873649.574281:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788873649.574283:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788873649.574285:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873649.574304:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788873649.574305:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873649.574307:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873649.574308:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788873649.574310:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788873649.574311:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873649.574312:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788873649.574333:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005845be44 from lustre-MDT0001 10000000:01000000:3.0:1788873649.574365:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788873649.574368:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788873649.574376:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3480da19c0 local copy 10000000:01000000:3.0:1788873649.574380:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788873649.574419:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873649.574431:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873649.574440:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873649.574460:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c65e3c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858986880:0@lo:101: 00000100:00100000:3.0:1788873649.574497:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.574533:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a3be2bb going to sleep for 11 seconds 00000100:00100000:2.0:1788873649.574648:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858986880 00000100:00100000:2.0:1788873649.574657:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858986880 00000100:00100000:2.0:1788873649.574708:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788873649.574718:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b21e602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:7440:x1875769858986880:12345-0@lo:101: 00010000:00010000:2.0:1788873649.574731:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873649.574744:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030567776/0x25c660afb0a9b202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b1fb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.574767:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030567776/0x25c660afb0a9b202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b1fb expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.574775:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030567776/0x25c660afb0a9b202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1fb expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.574803:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030567776, rc 0) 00000100:00100000:2.0:1788873649.574844:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b21e602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:7440:x1875769858986880:12345-0@lo:101: Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.574851:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788873649.574921:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c65e3c7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858986880:0@lo:101: 00010000:00010000:1.0:1788873649.574933:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.574941:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.575045:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987008:0@lo:501: 00000100:00100000:1.0:1788873649.575072:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.575096:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbc25dfa going to sleep for 11 seconds 00000100:00100000:2.0:1788873649.575317:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987008 00000100:00100000:2.0:1788873649.575323:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987008 00000100:00100000:2.0:1788873649.575354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873649.575361:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a6c262 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:7440:x1875769858987008:12345-0@lo:501: 00000100:00100000:2.0:1788873649.575431:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a6c262 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:7440:x1875769858987008:12345-0@lo:501: Request processed in 70us (358us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873649.575438:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788873649.575508:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987008:0@lo:501: 10000000:01000000:1.0:1788873649.575521:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788873649.575538:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788873649.575543:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575552:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575559:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575585:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788873649.575611:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d34651cb800 10000000:01000000:1.0:1788873649.575618:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788873649.575623:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d3480da19c0 10000000:01000000:1.0:1788873649.575625:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788873649.575628:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d3480da19c0 from 1 10000000:01000000:1.0:1788873649.575631:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788873649.575652:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575660:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575682:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.575707:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987136:0@lo:101: 00000100:00100000:1.0:1788873649.575738:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.575755:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.575770:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987136 00000100:00100000:1.0:1788873649.575774:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987136 00000100:00100000:1.0:1788873649.575813:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873649.575819:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b10e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:7440:x1875769858987136:12345-0@lo:101: 00010000:00010000:1.0:1788873649.575828:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873649.575840:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053eebf26/0x25c660afb0a9b210 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b209 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575856:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053eebf26/0x25c660afb0a9b210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b209 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575864:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053eebf26/0x25c660afb0a9b210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b209 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575872:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053eebf26, rc 0) 00000100:00100000:1.0:1788873649.575900:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b10e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:7440:x1875769858987136:12345-0@lo:101: Request processed in 82us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.575906:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873649.575936:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987136:0@lo:101: 00010000:00010000:1.0:1788873649.575946:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.575974:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873649.575989:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788873649.575996:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576003:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 00000000212be891/0x25c660afb0a9b209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873649.576011:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d34651cb800 10000000:01000000:1.0:1788873649.576015:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788873649.576019:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d34651cb800 from 1 10000000:01000000:1.0:1788873649.576021:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788873649.576036:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576043:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576049:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.576061:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987264:0@lo:101: 00000100:00100000:1.0:1788873649.576087:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.576101:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.576113:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987264 00000100:00100000:1.0:1788873649.576116:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987264 00000100:00100000:1.0:1788873649.576139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873649.576144:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e47d9737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+11:7440:x1875769858987264:12345-0@lo:101: 00010000:00010000:1.0:1788873649.576152:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873649.576160:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002cd0cf8b/0x25c660afb0a9b21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b217 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576173:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002cd0cf8b/0x25c660afb0a9b21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b217 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576181:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002cd0cf8b/0x25c660afb0a9b21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b217 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576188:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002cd0cf8b, rc 0) 00000100:00100000:1.0:1788873649.576250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e47d9737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:7440:x1875769858987264:12345-0@lo:101: Request processed in 106us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.576256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873649.576282:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987264:0@lo:101: 00010000:00010000:1.0:1788873649.576291:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576297:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873649.576305:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788873649.576307:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576312:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 00000000acafb622/0x25c660afb0a9b217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873649.576328:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788873649.576331:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788873649.576334:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d34651cb800 10000000:01000000:1.0:1788873649.576336:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788873649.576339:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788873649.576342:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788873649.576369:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576375:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576382:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.576393:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987392:0@lo:101: 00000100:00100000:1.0:1788873649.576421:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.576435:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.576447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987392 00000100:00100000:1.0:1788873649.576450:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987392 00000100:00100000:1.0:1788873649.576467:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788873649.576472:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b6c734a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:7440:x1875769858987392:12345-0@lo:101: 00010000:00010000:1.0:1788873649.576477:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873649.576483:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000840f7496/0x25c660afb0a9b22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b225 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576495:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000840f7496/0x25c660afb0a9b22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576514:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000840f7496/0x25c660afb0a9b22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576520:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000840f7496, rc 0) 00000100:00100000:1.0:1788873649.576547:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b6c734a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987392:12345-0@lo:101: Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.576553:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788873649.576580:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987392:0@lo:101: 00010000:00010000:1.0:1788873649.576589:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.576595:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.576673:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987520:0@lo:501: 00000100:00100000:1.0:1788873649.576696:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.576709:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.576720:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987520 00000100:00100000:1.0:1788873649.576724:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987520 00000100:00100000:1.0:1788873649.576739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873649.576743:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e585e92c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987520:12345-0@lo:501: 00000100:00100000:1.0:1788873649.576835:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e585e92c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987520:12345-0@lo:501: Request processed in 91us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.576841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873649.576867:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987520:0@lo:501: 00000100:00100000:1.0:1788873649.576891:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987648:0@lo:503: 00000100:00100000:1.0:1788873649.576932:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.576944:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.576955:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987648 00000100:00100000:1.0:1788873649.576958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987648 00000100:00100000:1.0:1788873649.576973:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788873649.576977:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf0f0c73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987648:12345-0@lo:503: 00000100:00100000:1.0:1788873649.577046:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf0f0c73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987648:12345-0@lo:503: Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.577052:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788873649.577089:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987648:0@lo:503: 00000040:00080000:1.0:1788873649.577383:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788873649.577454:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987776:0@lo:502: 00000100:00100000:1.0:1788873649.577485:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.577500:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.577513:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987776 00000100:00100000:1.0:1788873649.577517:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987776 00000100:00100000:1.0:1788873649.577534:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788873649.577539:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fa84592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987776:12345-0@lo:502: 00000100:00100000:1.0:1788873649.577613:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fa84592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987776:12345-0@lo:502: Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.577619:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788873649.577656:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987776:0@lo:502: 00000040:00080000:1.0:1788873649.577846:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788873649.577870:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788873649.577883:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788873649.577895:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788873649.577907:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788873649.577931:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788873649.577945:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788873649.577955:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788873649.577966:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788873649.577993:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788873649.578008:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788873649.578019:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788873649.578031:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788873649.578042:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788873649.578054:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788873649.578067:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788873649.578081:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788873649.578093:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788873649.578104:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788873649.578115:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788873649.578126:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788873649.578139:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788873649.578151:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788873649.578171:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987904:0@lo:502: 00000100:00100000:1.0:1788873649.578247:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.578262:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009604af84 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.578279:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858987904 00000100:00100000:1.0:1788873649.578282:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858987904 00000100:00100000:1.0:1788873649.578303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788873649.578308:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000787d85e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987904:12345-0@lo:502: 00000100:00100000:1.0:1788873649.578390:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000787d85e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858987904:12345-0@lo:502: Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.578397:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788873649.578436:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858987904:0@lo:502: 00000040:00080000:1.0:1788873649.578473:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788873649.578486:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:2.0:1788873649.580937:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873649.580950:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.580964:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdb9c2e5 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:2.0:1788873649.580968:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.580977:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873649.580984:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873649.580991:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873649.581034:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.581061:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873649.581097:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.581104:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b202 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.581123:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873649.581125:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873649.581126:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873649.581137:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788873649.581154:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be9e426a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769858988032:0@lo:103: 00000100:00100000:2.0:1788873649.581241:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.581286:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988032 00000100:00100000:2.0:1788873649.581293:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988032 00000100:00100000:2.0:1788873649.581342:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873649.581350:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d3d789d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3633:x1875769858988032:12345-0@lo:103: 00010000:00010000:2.0:1788873649.581364:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873649.581379:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030567776/0x25c660afb0a9b202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b1fb expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.581393:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873649.581425:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d3d789d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:3633:x1875769858988032:12345-0@lo:103: Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.581432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873649.581477:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be9e426a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769858988032:0@lo:103: 00000020:01000000:3.0:1788873649.584146:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873649.584163:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873649.584166:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788873649.584172:0:7452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788873649.584175:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873649.584190:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002c94e67c) 00000020:00000080:3.0:1788873649.584242:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788873649.584250:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788873649.584323:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788873649.584330:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9b23a 00000020:00000080:3.0:1788873649.584566:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788873649.584572:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873649.584575:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873649.584577:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788873649.584579:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873649.584583:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873649.584584:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788873649.584586:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873649.584593:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000862cdb3b) 00000020:00000080:3.0:1788873649.584603:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788873649.584607:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788873649.584608:0:7452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788873649.584611:0:7452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788873649.584617:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788873649.584660:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005845be44 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788873649.584672:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000e8c3b2bc) 00000020:00000080:3.0:1788873649.584681:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788873649.584782:0:7452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788873649.584788:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b24f 00000020:00000080:3.0:1788873649.584905:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788873649.584911:0:7452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788873649.584916:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x25c660afb0a9b256 00080000:01000000:3.0:1788873649.584922:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788873649.584925:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9b25d 00080000:10000000:3.0:1788873649.585422:0:7452:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788873649.585545:0:7452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788873649.722158:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788873649.724040:0:7452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788873649.727614:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788873649.728360:0:7452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788873649.752821:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788873649.752855:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873649.752863:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873649.752865:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788873649.752870:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873649.752876:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873649.752877:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788873649.752880:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788873649.752885:0:7452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:00000080:2.0:1788873649.752924:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873649.752964:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000e13482bb) 00000020:00000080:2.0:1788873649.753234:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788873649.753242:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788873649.753461:0:7452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788873649.753469:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788873649.753477:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9b26b 00010000:00080000:2.0:1788873649.753508:0:7452:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a6e5b760@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873649.757173:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788873649.758753:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788873649.758769:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788873649.758817:0:7452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788873649.758839:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b272 00000100:00080000:0.0:1788873649.758850:0:7452:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873649.758855:0:7452:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a6e5b760 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873649.758890:0:7452:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000031a905f4 x1875769858988160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788873649.758908:0:7452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788873649.758964:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873649.758970:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873649.758984:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788873649.758988:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788873649.758998:0:7452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788873649.759000:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1788873649.759003:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be9e426a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858988288:0@lo:400: 00000020:01000000:0.0:1788873649.759003:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788873649.759006:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788873649.759012:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873649.759015:0:7452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788873649.759017:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873649.759023:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873649.759025:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788873649.759030:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788873649.759064:0:7452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788873649.759075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788873649.759081:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873649.759086:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873649.759087:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788873649.759090:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873649.759093:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873649.759095:0:7452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788873649.759098:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788873649.759100:0:7452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788873649.759132:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873649.759135:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873649.759137:0:7452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788873649.759140:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1788873649.759152:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988288 00000100:00100000:2.0:1788873649.759159:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988288 00000100:00100000:3.0:1788873649.759463:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031a905f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769858988160:0@lo:38: 00000100:00100000:3.0:1788873649.759502:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.759773:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873649.759784:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e1a1d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858988288:12345-0@lo:400: 00000100:00100000:2.0:1788873649.759886:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e1a1d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858988288:12345-0@lo:400: Request processed in 104us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.759896:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873649.759903:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988160 00000100:00100000:0.0:1788873649.759910:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988160 00000020:01000000:2.0:1788873649.759927:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:0.0:1788873649.759936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873649.759942:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f8d182 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1875769858988160:12345-0@lo:38: 10000000:01000000:2.0:1788873649.759960:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00080000:0.0:1788873649.759963:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00010000:00010000:2.0:1788873649.759977:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788873649.759997:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b279 00010000:00010000:2.0:1788873649.760001:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 00000000c12238c7/0x25c660afb0a9b225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873649.760010:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34651cb800 from 1 00000004:00100000:0.0:1788873649.760012:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 10000000:01000000:2.0:1788873649.760013:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000001:00000004:0.0:1788873649.760021:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788873649.760045:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.760054:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.760061:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.760078:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988416:0@lo:101: 00000100:00100000:2.0:1788873649.760111:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.760133:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c906e93c going to sleep for 11 seconds 00010000:00080000:3.0:1788873649.760189:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000be9e426a x1875769858988288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873649.760623:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988416 00000100:00100000:0.0:1788873649.760634:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988416 00000100:00100000:0.0:1788873649.760666:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788873649.760672:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb196a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+12:7440:x1875769858988416:12345-0@lo:101: 00010000:00010000:0.0:1788873649.760682:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873649.760751:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b280 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.760773:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.760783:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873649.760829:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be9e426a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858988288:0@lo:400: 00010000:00010000:0.0:1788873649.761116:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef472353, rc 0) 00000100:00100000:0.0:1788873649.761167:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb196a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858988416:12345-0@lo:101: Request processed in 495us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.761173:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873649.762183:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988416:0@lo:101: 00010000:00010000:3.0:1788873649.762786:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873649.762800:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873649.763597:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b97958bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988544:0@lo:256: 00000100:00100000:3.0:1788873649.763940:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.763996:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be23e8a6 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.764543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988544 00000100:00100000:0.0:1788873649.764552:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988544 00000100:00100000:0.0:1788873649.764604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873649.764612:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035901e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858988544:12345-0@lo:256: 20000000:01000000:0.0:1788873649.764633:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 00000100:00080000:1.0:1788873649.767140:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000001d7d701 : changing import state from RECOVER to FULL 20000000:01000000:0.0:1788873649.770389:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788873649.770400:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788873649.772278:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035901e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858988544:12345-0@lo:256: Request processed in 7659us (8331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.772294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788873649.773367:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f8d182 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875769858988160:12345-0@lo:38: Request processed in 13419us (13860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.773386:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873649.773522:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788873649.773533:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788873649.773543:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788873649.773548:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788873649.773552:0:3632:0:(import.c:65:import_set_state_nolock()) 00000000a6e5b760 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788873649.773569:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031a905f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769858988160:0@lo:38: 00000100:00100000:2.0:1788873649.774286:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769858988672:0@lo:41: 00000100:00100000:2.0:1788873649.774339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.774441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988672 00000100:00100000:0.0:1788873649.774449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988672 00000100:00100000:0.0:1788873649.774511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873649.774519:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000434bcf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1875769858988672:12345-0@lo:41: 00000004:00000024:0.0:1788873649.774557:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788873649.774623:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000434bcf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1875769858988672:12345-0@lo:41: Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.774630:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873649.774720:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769858988672:0@lo:41: 00000100:00100000:3.0:1788873649.774988:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b97958bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988544:0@lo:256: 10000000:01000000:1.0:1788873649.775664:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788873649.776083:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.776096:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873649.776186:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34651cb800 from 1 10000000:01000000:2.0:1788873649.776190:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788873649.776261:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.776269:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.776279:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.776299:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988800:0@lo:101: 00000100:00100000:2.0:1788873649.776358:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.776390:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98dc378 going to sleep for 11 seconds 00000100:00100000:1.0:1788873649.776583:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988800 00000100:00100000:1.0:1788873649.776590:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988800 00000100:00100000:1.0:1788873649.776633:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788873649.776639:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d893018d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:7440:x1875769858988800:12345-0@lo:101: 00010000:00010000:1.0:1788873649.776651:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873649.776663:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b28e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.776683:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.776764:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.776773:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000251b9b14, rc 0) 00000100:00100000:1.0:1788873649.776879:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d893018d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:7440:x1875769858988800:12345-0@lo:101: Request processed in 240us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.776886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788873649.776978:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988800:0@lo:101: 00010000:00010000:2.0:1788873649.776992:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.777000:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873649.777099:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988928:0@lo:501: 00000100:00100000:2.0:1788873649.777123:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.777144:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98dc378 going to sleep for 11 seconds 00000100:00100000:3.0:1788873649.777193:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858988928 00000100:00100000:3.0:1788873649.777225:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858988928 00000100:00100000:3.0:1788873649.777254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788873649.777260:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9af9d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:7440:x1875769858988928:12345-0@lo:501: 00000100:00100000:3.0:1788873649.777353:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9af9d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:7440:x1875769858988928:12345-0@lo:501: Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873649.777359:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788873649.777532:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858988928:0@lo:501: 00000100:00100000:2.0:1788873649.777558:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989056:0@lo:503: 00000100:00100000:2.0:1788873649.777596:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.777629:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e98dc378 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.777727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989056 00000100:00100000:0.0:1788873649.777732:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989056 00000100:00100000:0.0:1788873649.777764:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873649.777771:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d74ccaa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:7440:x1875769858989056:12345-0@lo:503: 00000040:00080000:0.0:1788873649.777994:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873649.778040:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d74ccaa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:7440:x1875769858989056:12345-0@lo:503: Request processed in 270us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.778047:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788873649.778114:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989056:0@lo:503: 00000040:00080000:2.0:1788873649.778426:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873649.778473:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788873649.778550:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873649.784184:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788873649.784514:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788873649.784547:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873649.784778:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.784849:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873649.784911:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788873649.784915:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d34651cb800 10000000:01000000:0.0:1788873649.784918:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d34651cb800 10000000:01000000:0.0:1788873649.784922:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873649.784928:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34651cb800 from 1 10000000:01000000:0.0:1788873649.784931:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788873649.784970:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.784991:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.785001:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873649.785026:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6faa78b pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989184:0@lo:101: 00000100:00100000:0.0:1788873649.785095:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.785175:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c55e655b going to sleep for 11 seconds 00000100:00100000:2.0:1788873649.785424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989184 00000100:00100000:2.0:1788873649.785431:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989184 00000100:00100000:2.0:1788873649.785502:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788873649.785512:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000586d1748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:7440:x1875769858989184:12345-0@lo:101: 00010000:00010000:2.0:1788873649.785525:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873649.785536:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f637364a/0x25c660afb0a9b2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b29c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.785561:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f637364a/0x25c660afb0a9b2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.785571:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f637364a/0x25c660afb0a9b2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873649.785593:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f637364a, rc 0) 00000100:00100000:2.0:1788873649.785642:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000586d1748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989184:12345-0@lo:101: Request processed in 132us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.785648:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788873649.785736:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6faa78b pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989184:0@lo:101: 00010000:00010000:3.0:1788873649.785749:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873649.785758:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873649.786036:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989312:0@lo:501: 00000100:00100000:3.0:1788873649.786066:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.786258:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ae497a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.786402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989312 00000100:00100000:0.0:1788873649.786407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989312 00000100:00100000:0.0:1788873649.786435:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873649.786441:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006acc9f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989312:12345-0@lo:501: 00000100:00100000:0.0:1788873649.786561:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006acc9f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989312:12345-0@lo:501: Request processed in 121us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.786568:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788873649.786710:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989312:0@lo:501: 00000100:00100000:3.0:1788873649.786762:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989440:0@lo:503: 00000100:00100000:3.0:1788873649.786933:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.786949:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ae497a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.786987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989440 00000100:00100000:0.0:1788873649.786991:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989440 00000100:00100000:0.0:1788873649.787005:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873649.787010:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b11f2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989440:12345-0@lo:503: 00000100:00100000:0.0:1788873649.787086:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b11f2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989440:12345-0@lo:503: Request processed in 75us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.787092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788873649.787163:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989440:0@lo:503: 00000040:00080000:3.0:1788873649.787478:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873649.787552:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989568:0@lo:502: 00000100:00100000:3.0:1788873649.787758:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.787783:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ae497a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.787947:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989568 00000100:00100000:0.0:1788873649.787953:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989568 00000100:00100000:0.0:1788873649.787979:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873649.787985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018c53a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989568:12345-0@lo:502: 00000100:00100000:0.0:1788873649.788085:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018c53a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989568:12345-0@lo:502: Request processed in 100us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.788092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788873649.788177:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989568:0@lo:502: 00000040:00080000:3.0:1788873649.788398:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788873649.788424:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788873649.788440:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788873649.788454:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788873649.788469:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788873649.788482:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788873649.788494:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788873649.788507:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788873649.788521:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788873649.788533:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788873649.788562:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788873649.788579:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788873649.788609:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788873649.788633:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788873649.788647:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788873649.788660:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788873649.788675:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788873649.788905:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788873649.788923:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788873649.788938:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788873649.788951:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788873649.788962:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788873649.788975:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788873649.788989:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788873649.789002:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788873649.789016:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788873649.789043:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788873649.789057:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788873649.789087:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989696:0@lo:502: 00000100:00100000:3.0:1788873649.789137:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.789174:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ae497a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.789311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989696 00000100:00100000:0.0:1788873649.789319:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989696 00000100:00100000:0.0:1788873649.789350:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788873649.789356:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a2a559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989696:12345-0@lo:502: 00000100:00100000:0.0:1788873649.789445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a2a559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989696:12345-0@lo:502: Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.789453:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788873649.789548:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009436c7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989696:0@lo:502: 00000040:00080000:3.0:1788873649.789654:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788873649.789662:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788873649.790441:0:7458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788873649.790456:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000289b70ff) 00000020:00000080:2.0:1788873649.790476:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788873649.790549:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005845be44 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788873649.790553:0:7458:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005845be44 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788873649.790555:0:7458:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005845be44 3 00010000:00080000:2.0:1788873649.790603:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000006594a01@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873649.793312:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788873649.793685:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788873649.793869:0:7458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788873649.793884:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x25c660afb0a9b2b1 00000100:00080000:2.0:1788873649.793893:0:7458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788873649.793900:0:7458:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000006594a01 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873649.793936:0:7458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dd4c9570 x1875769858989824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873649.793962:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788873649.794050:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769858989824:0@lo:38: 00000100:00100000:3.0:1788873649.794124:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.794193:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989824 00000100:00100000:3.0:1788873649.794231:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989824 00000100:00100000:3.0:1788873649.794265:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788873649.794271:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009436c7de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769858989824:12345-0@lo:38: 00010000:00080000:3.0:1788873649.794295:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788873649.794325:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x25c660afb0a9b2b8 00000004:00100000:3.0:1788873649.794350:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788873649.794389:0:6509:0:(import.c:65:import_set_state_nolock()) 00000000ba034fbf : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873649.794438:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009436c7de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875769858989824:12345-0@lo:38: Request processed in 166us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873649.794444:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788873649.794480:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dd4c9570 x1875769858989824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873649.794490:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873649.794497:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788873649.794504:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788873649.794508:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788873649.794509:0:3632:0:(import.c:65:import_set_state_nolock()) 0000000006594a01 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788873649.794514:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769858989824:0@lo:38: 00000040:00080000:2.0:1788873649.795191:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1788873649.795394:0:7459:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1788873649.795542:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788873649.795575:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788873649.795605:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.795618:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 00000000f5993df8/0x25c660afb0a9b29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788873649.795677:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788873649.795680:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788873649.795681:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873649.795682:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873649.795683:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873649.795684:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873649.795919:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873649.795921:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788873649.795923:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788873649.795924:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873649.795925:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788873649.795929:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788873649.795932:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788873649.795938:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788873649.795939:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873649.795940:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873649.795941:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873649.795942:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873649.795943:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873649.795944:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788873649.795944:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788873649.795945:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873649.795946:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788873649.795972:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788873649.795992:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b721ff3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989952:0@lo:253: 00000100:00100000:0.0:1788873649.796060:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.796105:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d999fe7 going to sleep for 11 seconds 00000100:00100000:2.0:1788873649.796157:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858989952 00000100:00100000:2.0:1788873649.796163:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858989952 00000100:00100000:2.0:1788873649.796292:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788873649.796300:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017033b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989952:12345-0@lo:253: 20000000:01000000:2.0:1788873649.796323:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788873649.796335:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788873649.799442:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788873649.799597:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788873649.799612:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788873649.800055:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017033b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7440:x1875769858989952:12345-0@lo:253: Request processed in 3753us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873649.800069:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 20000000:01000000:0.0:1788873649.800903:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788873649.800910:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788873649.800930:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.800947:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.800955:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.800962:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801006:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801021:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873649.801049:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1d1659e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769858990080:0@lo:104: 00000100:00100000:0.0:1788873649.801096:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873649.801146:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801154:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 14 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873649.801162:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769858990208:0@lo:104: 00000100:00100000:0.0:1788873649.801182:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.801236:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c55e655b going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.801261:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990080 00000100:00100000:0.0:1788873649.801270:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990080 00000100:00100000:0.0:1788873649.801310:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990208 00000100:00100000:0.0:1788873649.801313:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990208 00000100:00100000:0.0:1788873649.801326:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873649.801332:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5029df2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6526:x1875769858990080:12345-0@lo:104: 00010000:00010000:0.0:1788873649.801345:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801390:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873649.801395:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5029df2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6526:x1875769858990080:12345-0@lo:104: Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.801402:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873649.801417:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788873649.801423:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acd8c1b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769858990208:12345-0@lo:104: 00010000:00010000:0.0:1788873649.801430:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801474:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788873649.801478:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acd8c1b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769858990208:12345-0@lo:104: Request processed in 57us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.801484:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788873649.801502:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788873649.801508:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801515:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030567776 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:0.0:1788873649.801518:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801525:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873649.801531:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873649.801536:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788873649.801563:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801571:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873649.801592:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801599:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 0000000030567776/0x25c660afb0a9b280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b287 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801623:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873649.801626:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801632:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a79f9ef2 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:0.0:1788873649.801635:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801640:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873649.801645:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873649.801650:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788873649.801661:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801667:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873649.801672:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801678:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 00000000a79f9ef2/0x25c660afb0a9b1d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873649.801692:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873649.801693:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873649.801695:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873649.801720:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1d1659e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769858990080:0@lo:104: 00000100:00100000:0.0:1788873649.801737:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769858990208:0@lo:104: 00010000:00010000:0.0:1788873649.801757:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.802496:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000987e2dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858990464:0@lo:103: 00000100:00100000:1.0:1788873649.802539:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.802566:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873649.802571:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccbd3630 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858990336:0@lo:103: 00000100:00100000:1.0:1788873649.802605:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873649.802632:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990464 00000100:00100000:1.0:1788873649.802636:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990464 00010000:00010000:1.0:1788873649.802657:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 15 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.802680:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990336 00000100:00100000:1.0:1788873649.802682:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990336 00010000:00010000:1.0:1788873649.802691:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 16 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.802703:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788873649.802708:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f95542e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3634:x1875769858990464:12345-0@lo:103: 00010000:00010000:1.0:1788873649.802718:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873649.802722:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 16 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.802730:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 16 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.802743:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000664d3857/0x25c660afb0a9b1d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b1d1 expref: 16 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.802755:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873649.802781:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f95542e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3634:x1875769858990464:12345-0@lo:103: Request processed in 74us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.803134:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788873649.803154:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873649.803159:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e2c4808 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3634:x1875769858990336:12345-0@lo:103: 00010000:00010000:1.0:1788873649.803167:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873649.803172:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.803181:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.803190:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef472353/0x25c660afb0a9b287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b280 expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873649.803257:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873649.803284:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b721ff3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7440:1875769858989952:0@lo:253: 10000000:01000000:3.0:1788873649.803297:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788873649.803300:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788873649.803302:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788873649.803303:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873649.803305:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873649.803306:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873649.803308:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873649.803309:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788873649.803311:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788873649.803312:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788873649.803314:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873649.803315:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788873649.803328:0:7440:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788873649.806536:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806547:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788873649.806567:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005658170s 00010000:00010000:1.0:1788873649.806571:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806577:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806584:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806590:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806602:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fea60f7b already unused, calling callback (00000000356f5322) 00010000:00010000:1.0:1788873649.806605:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806612:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806628:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806637:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873649.806660:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806667:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873649.806673:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fea60f7b/0x25c660afb0a9b2bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873649.806723:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000987e2dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858990464:0@lo:103: 00000100:00100000:1.0:1788873649.807548:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e2c4808 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3634:x1875769858990336:12345-0@lo:103: Request processed in 4386us (4940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.807560:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873649.807607:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccbd3630 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858990336:0@lo:103: 00080000:10000000:2.0:1788873649.816258:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788873649.816434:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788873649.816636:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788873649.817432:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788873649.817583:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788873649.817682:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788873649.824780:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788873649.825168:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788873649.825546:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788873649.825782:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788873649.826073:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788873649.826311:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788873649.828169:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788873649.828478:0:7464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788873649.828527:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004180d32c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1875769858990592:0@lo:700: 00000100:00100000:2.0:1788873649.828590:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.828635:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a835351 going to sleep for 11 seconds 00000040:01000000:0.0:1788873649.828682:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788873649.828992:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858990720:0@lo:1000: 00000100:00100000:0.0:1788873649.829026:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.829052:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990720 00000100:00100000:0.0:1788873649.829058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990720 00000100:00100000:0.0:1788873649.829106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873649.829115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d1659e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858990720:12345-0@lo:1000: 00000100:00100000:0.0:1788873649.829182:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d1659e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858990720:12345-0@lo:1000: Request processed in 68us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.829188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873649.829250:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1b56455 going to sleep for 11 seconds 00000100:00100000:0.0:1788873649.829272:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858990720:0@lo:1000: 00000040:01000000:0.0:1788873649.829296:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788873649.829316:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858990848:0@lo:700: 00000100:00100000:0.0:1788873649.829338:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.829361:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000316c1b5d going to sleep for 11 seconds 00000040:01000000:2.0:1788873649.829732:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788873649.829833:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788873649.830293:0:7440:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788873649.830374:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1788873649.830837:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990592 00000100:00100000:3.0:1788873649.830851:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990592 00000100:00100000:3.0:1788873649.830900:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873649.830907:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003323ae85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1875769858990592:12345-0@lo:700: 00000100:00100000:0.0:1788873649.831261:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990848 00000100:00100000:0.0:1788873649.831274:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990848 00000100:00100000:0.0:1788873649.831314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873649.831321:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a753e114 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858990848:12345-0@lo:700: 00000100:00100000:0.0:1788873649.831392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a753e114 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858990848:12345-0@lo:700: Request processed in 73us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873649.831399:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873649.831438:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858990848:0@lo:700: 00000100:00100000:0.0:1788873649.831504:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875769858990976:0@lo:900: 00000100:00100000:0.0:1788873649.831539:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873649.831560:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000316c1b5d going to sleep for 11 seconds 00000040:00080000:2.0:1788873649.832033:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788873649.832554:0:7463:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788873649.832559:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788873649.832580:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858990976 00000100:00100000:1.0:1788873649.832592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858990976 00000100:00100000:1.0:1788873649.832632:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873649.832638:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032c1f613 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1875769858990976:12345-0@lo:900: 00000100:00100000:1.0:1788873649.832770:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032c1f613 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1875769858990976:12345-0@lo:900: Request processed in 132us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873649.832777:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788873649.832898:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006dda03f9 x1875769858990976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788873665 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873649.832910:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875769858990976:0@lo:900: 00000100:00100000:3.0:1788873649.833002:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858991104:0@lo:1000: 00000100:00100000:3.0:1788873649.833034:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.833066:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858991104 00000100:00100000:3.0:1788873649.833069:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858991104 00000100:00100000:3.0:1788873649.833096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873649.833102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019422aaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858991104:12345-0@lo:1000: 00000100:00100000:3.0:1788873649.833150:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019422aaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858991104:12345-0@lo:1000: Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873649.833156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873649.833174:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bb2b1da going to sleep for 11 seconds 00000100:00100000:3.0:1788873649.833186:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858991104:0@lo:1000: 00000004:00080000:3.0:1788873649.833250:0:7465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a2491a6d with version 0 00000020:00100000:3.0:1788873649.833263:0:7465:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788873649.833267:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000290864c3 x1875769858991360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873649.833278:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858991360:0@lo:1000: 00000100:00100000:3.0:1788873649.833298:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.833315:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858991360 00000100:00100000:3.0:1788873649.833318:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858991360 00000100:00100000:3.0:1788873649.833335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873649.833346:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc71bf97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858991360:12345-0@lo:1000: 00000100:00100000:3.0:1788873649.833624:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000242c5e47 going to sleep for 11 seconds 00000040:00080000:2.0:1788873649.834847:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788873649.835406:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788873649.835437:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788873649.835630:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788873649.835833:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788873649.837068:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788873649.839629:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788873649.839943:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788873649.840074:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788873649.840235:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788873649.840409:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788873649.840523:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788873649.840633:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788873649.840994:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788873649.841100:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788873649.841283:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788873649.841391:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788873649.841738:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788873649.842041:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788873649.842166:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788873649.842355:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788873649.842873:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788873649.843002:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788873649.843126:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788873649.843347:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788873649.843568:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788873649.843672:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788873649.844073:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788873649.844238:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788873649.844378:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788873649.844558:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788873649.844668:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788873649.845075:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788873649.845183:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788873649.845314:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788873649.845433:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788873649.845654:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788873649.845985:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788873649.849229:0:7440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788873649.849266:0:7440:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbcd181a27988 00100000:10000000:2.0:1788873649.849274:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788873649.849933:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788873649.849968:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788873649.849985:0:7440:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788873649.850002:0:7440:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788873649.853934:0:7440:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873649.854140:0:7440:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1788873649.854597:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788873649.854725:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc71bf97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858991360:12345-0@lo:1000: Request processed in 21377us (21423us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788873649.854737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:3.0:1788873649.855584:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1788873649.870698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003323ae85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1875769858990592:12345-0@lo:700: Request processed in 39789us (42105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873649.870715:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788873649.873396:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004180d32c x1875769858990592/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788873665 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873649.873415:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004180d32c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1875769858990592:0@lo:700: 40000000:02000000:2.0:1788873649.873435:0:7464:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:3.0:1788873649.876624:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788873649.876631:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788873649.876649:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858991360:0@lo:1000: 00000100:00100000:3.0:1788873649.876873:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858991488:0@lo:1000: 00000100:00100000:3.0:1788873649.876931:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873649.876978:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858991488 00000100:00100000:3.0:1788873649.876985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858991488 00000100:00100000:3.0:1788873649.877030:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873649.877037:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095b21a02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858991488:12345-0@lo:1000: 00000100:00100000:3.0:1788873649.877104:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095b21a02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875769858991488:12345-0@lo:1000: Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873649.877110:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873649.877154:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccce0d2a going to sleep for 11 seconds 00000100:00100000:3.0:1788873649.877167:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875769858991488:0@lo:1000: 00000040:00080000:3.0:1788873649.877181:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788873649.877239:0:7465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a2491a6d with version 1 00000040:00080000:3.0:1788873649.879642:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788873649.879862:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788873649.881512:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e7b04063 version 1 rpc_version 1 00000020:00100000:2.0:1788873649.881548:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788873649.881559:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004180d32c x1875769858991744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873649.881580:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004180d32c pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1875769858991744:0@lo:1000: 00000100:00100000:2.0:1788873649.881648:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873649.881688:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a835351 going to sleep for 11 seconds 00000100:00100000:2.0:1788873649.881898:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858991744 00000100:00100000:2.0:1788873649.881906:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858991744 00000100:00100000:2.0:1788873649.881953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788873649.881961:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006735f57d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7455:x1875769858991744:12345-0@lo:1000: 00000001:00080000:0.0:1788873649.888332:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788873649.888459:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006735f57d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7455:x1875769858991744:12345-0@lo:1000: Request processed in 6495us (6809us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788873649.888472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788873649.888532:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788873649.888536:0:7455:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788873649.888553:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004180d32c pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1875769858991744:0@lo:1000: 00000040:00080000:1.0:1788873649.904611:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873649.912598:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788873649.912673:0:7464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788873649.912678:0:7464:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788873650.290769:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873651.310507:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873652.340292:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873653.359569:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873654.387635:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873655.022689:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769858991872:0@lo:400: 00000100:00100000:2.0:1788873655.022762:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873655.024267:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873655.024283:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ba8445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858992000:0@lo:400: 00000100:00100000:2.0:1788873655.024337:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873655.024376:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858991872 00000100:00100000:2.0:1788873655.024384:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858991872 00000100:00100000:2.0:1788873655.024427:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788873655.024442:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dc7c069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3635:x1875769858991872:12345-0@lo:400: 00000100:00100000:2.0:1788873655.024493:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dc7c069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:3635:x1875769858991872:12345-0@lo:400: Request processed in 52us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873655.024500:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788873655.024559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992000 00000100:00100000:2.0:1788873655.024563:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992000 00000100:00100000:2.0:1788873655.024589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873655.024596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004180d32c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858992000:12345-0@lo:400: 00000100:00100000:2.0:1788873655.024626:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004180d32c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858992000:12345-0@lo:400: Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873655.024632:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788873655.024667:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000057ba8445 x1875769858992000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873655.024681:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ba8445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858992000:0@lo:400: 00000100:00100000:2.0:1788873655.024692:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769858991872:0@lo:400: 00000100:00100000:0.0:1788873655.024799:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873655.024808:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769858992128:0@lo:41: 00000100:00100000:0.0:1788873655.024839:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873655.024868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992128 00000100:00100000:0.0:1788873655.024872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992128 00000100:00100000:0.0:1788873655.024901:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788873655.024907:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d5a5e14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769858992128:12345-0@lo:41: 00000004:00000024:0.0:1788873655.024934:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788873655.025010:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d5a5e14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769858992128:12345-0@lo:41: Request processed in 103us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873655.025016:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788873655.025047:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769858992128:0@lo:41: 00000100:00100000:3.0:1788873655.026850:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873655.026896:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8a7321c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769858992256:0@lo:400: 00000100:00100000:3.0:1788873655.026949:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873655.026995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992256 00000100:00100000:3.0:1788873655.027001:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992256 00000100:00100000:3.0:1788873655.027041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873655.027048:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019774cb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769858992256:12345-0@lo:400: 00000100:00100000:3.0:1788873655.027088:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019774cb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769858992256:12345-0@lo:400: Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873655.027093:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788873655.027124:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c8a7321c x1875769858992256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873655.027136:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8a7321c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769858992256:0@lo:400: 00000001:02000400:1.0:1788873655.061236:0:7710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788873655.406508:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873656.431061:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788873656.654619:0:7762:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873656.654841:0:7762:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788873657.086877:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788873657.086889:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34651cb800 from 4 10000000:01000000:3.0:1788873657.086896:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788873657.086960:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873657.086976:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873657.086989:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873657.087042:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8a7321c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992384:0@lo:101: 00000100:00100000:3.0:1788873657.087148:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873657.087243:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000005fc454eb going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.087982:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992384 00000100:00100000:2.0:1788873657.087998:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992384 00000100:00100000:2.0:1788873657.088066:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873657.088076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caeff47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:6508:x1875769858992384:12345-0@lo:101: 00010000:00010000:2.0:1788873657.088095:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873657.088115:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4731f5d/0x25c660afb0a9b2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b2c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.088163:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4731f5d/0x25c660afb0a9b2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.088176:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4731f5d/0x25c660afb0a9b2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.088195:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4731f5d, rc 0) 00000100:00100000:2.0:1788873657.088284:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caeff47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:6508:x1875769858992384:12345-0@lo:101: Request processed in 209us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.088292:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873657.088372:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8a7321c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992384:0@lo:101: 00010000:00010000:2.0:1788873657.088393:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.088403:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873657.088468:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992512:0@lo:256: 00000100:00100000:2.0:1788873657.088505:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.088535:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076429861 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.088553:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992512 00000100:00100000:2.0:1788873657.088556:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992512 00000100:00100000:2.0:1788873657.088584:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873657.088589:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000636eac44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:6508:x1875769858992512:12345-0@lo:256: 20000000:01000000:2.0:1788873657.088606:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788873657.088625:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788873657.088629:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788873657.089850:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000636eac44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:6508:x1875769858992512:12345-0@lo:256: Request processed in 1254us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.089867:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873657.097273:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992512:0@lo:256: 10000000:01000000:2.0:1788873657.097385:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788873657.097405:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.097416:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 00000000bdb9c2e5/0x25c660afb0a9b2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873657.097428:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788873657.097431:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34473c7800 from 21 10000000:01000000:2.0:1788873657.097435:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788873657.097482:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.097491:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.097503:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873657.097528:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992640:0@lo:101: 00000100:00100000:2.0:1788873657.097626:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.102293:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992640 00000100:00100000:2.0:1788873657.102315:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992640 00000100:00100000:2.0:1788873657.102387:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873657.102397:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ebaee0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:6508:x1875769858992640:12345-0@lo:101: 00010000:00010000:2.0:1788873657.102418:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873657.102441:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f5c200c/0x25c660afb0a9b2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b2d4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.102476:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f5c200c/0x25c660afb0a9b2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.102502:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f5c200c/0x25c660afb0a9b2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.102512:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f5c200c, rc 0) 00000100:00100000:2.0:1788873657.102601:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ebaee0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769858992640:12345-0@lo:101: Request processed in 207us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.102608:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873657.104825:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076429861 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.104890:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992640:0@lo:101: 00010000:00010000:2.0:1788873657.104921:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.104936:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873657.105050:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992768:0@lo:501: 00000100:00100000:2.0:1788873657.105140:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.105190:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992768 00000100:00100000:2.0:1788873657.105197:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992768 00000100:00100000:2.0:1788873657.105258:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788873657.105266:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d5990fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769858992768:12345-0@lo:501: 00000100:00100000:2.0:1788873657.105412:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d5990fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769858992768:12345-0@lo:501: Request processed in 146us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.105419:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788873657.105466:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076429861 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.105476:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992768:0@lo:501: 00000100:00100000:2.0:1788873657.105515:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992896:0@lo:503: 00000100:00100000:2.0:1788873657.105553:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.105572:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858992896 00000100:00100000:2.0:1788873657.105574:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858992896 00000100:00100000:2.0:1788873657.105592:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788873657.105597:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2e1b06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769858992896:12345-0@lo:503: 00000100:00100000:2.0:1788873657.105669:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2e1b06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769858992896:12345-0@lo:503: Request processed in 72us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.105675:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788873657.107619:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076429861 going to sleep for 11 seconds 00000100:00100000:3.0:1788873657.107671:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858992896:0@lo:503: 00000100:00100000:2.0:1788873657.110421:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a45193b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7781:1875769858993024:0@lo:502: 00000100:00100000:2.0:1788873657.110533:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.110580:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993024 00000100:00100000:2.0:1788873657.110589:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993024 00000100:00100000:2.0:1788873657.110647:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788873657.110657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bbaead2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7781:x1875769858993024:12345-0@lo:502: 00000100:00100000:2.0:1788873657.119813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bbaead2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7781:x1875769858993024:12345-0@lo:502: Request processed in 9148us (9270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.119834:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788873657.119958:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 00000000554ade95 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.119998:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a45193b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7781:1875769858993024:0@lo:502: 00000100:00100000:2.0:1788873657.120104:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a45193b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7781:1875769858993152:0@lo:502: 00000100:00100000:2.0:1788873657.120183:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.121543:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 00000000554ade95 going to sleep for 11 seconds 00000100:00100000:3.0:1788873657.128776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993152 00000100:00100000:3.0:1788873657.128793:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993152 00000100:00100000:3.0:1788873657.128874:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788873657.128885:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f16c15c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7781:x1875769858993152:12345-0@lo:502: 00000100:00100000:3.0:1788873657.129108:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f16c15c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:7781:x1875769858993152:12345-0@lo:502: Request processed in 225us (8925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873657.129117:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788873657.135140:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a45193b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7781:1875769858993152:0@lo:502: 00000040:00080000:2.0:1788873657.135232:0:7781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788873657.135462:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788873657.135495:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788873657.135509:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873657.135522:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 0000000091f4fbb3/0x25c660afb0a9b2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873657.135533:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788873657.135665:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34473c7800 from 4 10000000:01000000:0.0:1788873657.135670:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873657.135720:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.135729:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.135739:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873657.135766:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993280:0@lo:101: 00000100:00100000:0.0:1788873657.135857:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.135945:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2f7a043 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.140779:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993280 00000100:00100000:2.0:1788873657.140803:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993280 00000100:00100000:3.0:1788873657.141064:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788873657.141077:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040182ce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769858993280:12345-0@lo:101: 00010000:00010000:3.0:1788873657.141105:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873657.141144:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a79f9ef2/0x25c660afb0a9b2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b2e2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873657.141193:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a79f9ef2/0x25c660afb0a9b2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873657.141226:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a79f9ef2/0x25c660afb0a9b2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873657.141236:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a79f9ef2, rc 0) 00000100:00100000:3.0:1788873657.141340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040182ce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769858993280:12345-0@lo:101: Request processed in 266us (5484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873657.141347:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788873657.141507:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993280:0@lo:101: 00010000:00010000:0.0:1788873657.141533:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.141543:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873657.141616:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993408:0@lo:256: 00000100:00100000:0.0:1788873657.141663:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.141697:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993408 00000100:00100000:0.0:1788873657.141702:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993408 00000100:00100000:0.0:1788873657.141726:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788873657.141732:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049cbdd8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769858993408:12345-0@lo:256: 20000000:01000000:0.0:1788873657.141748:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788873657.141770:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788873657.141773:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788873657.141845:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049cbdd8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769858993408:12345-0@lo:256: Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.141854:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788873657.141892:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2f7a043 going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.141905:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993408:0@lo:256: 10000000:01000000:0.0:1788873657.141948:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788873657.141955:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.141963:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000008fa9acd0/0x25c660afb0a9b2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873657.141972:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788873657.141975:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788873657.141978:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788873657.141997:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.142003:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.142011:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873657.142022:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993536:0@lo:101: 00000100:00100000:0.0:1788873657.142063:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.142086:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2f7a043 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.142336:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993536 00000100:00100000:2.0:1788873657.142341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993536 00000100:00100000:2.0:1788873657.142376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788873657.142382:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c7debc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769858993536:12345-0@lo:101: 00010000:00010000:2.0:1788873657.142391:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873657.142403:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030567776/0x25c660afb0a9b2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b2f0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.142421:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030567776/0x25c660afb0a9b2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.142430:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030567776/0x25c660afb0a9b2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.142438:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030567776, rc 0) 00000100:00100000:2.0:1788873657.142471:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c7debc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858993536:12345-0@lo:101: Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.142477:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788873657.142595:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993536:0@lo:101: 00010000:00010000:0.0:1788873657.142612:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.142619:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873657.142677:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993664:0@lo:501: 00000100:00100000:0.0:1788873657.142703:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.142728:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2f7a043 going to sleep for 11 seconds 00000100:00100000:2.0:1788873657.142765:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993664 00000100:00100000:2.0:1788873657.142770:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993664 00000100:00100000:2.0:1788873657.142828:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788873657.142834:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d57ea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858993664:12345-0@lo:501: 00000100:00100000:2.0:1788873657.142981:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d57ea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858993664:12345-0@lo:501: Request processed in 147us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.142988:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788873657.143053:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993664:0@lo:501: 00000100:00100000:3.0:1788873657.143083:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014a434b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993792:0@lo:503: 00000100:00100000:3.0:1788873657.143138:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873657.149447:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000316c1b5d going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.150602:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993792 00000100:00100000:0.0:1788873657.150618:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993792 00000100:00100000:2.0:1788873657.150785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788873657.150797:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccff7d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858993792:12345-0@lo:503: 00000100:00100000:2.0:1788873657.151056:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccff7d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858993792:12345-0@lo:503: Request processed in 261us (7916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.151066:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788873657.159701:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014a434b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858993792:0@lo:503: 00000100:00100000:1.0:1788873657.163191:0:7783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7783:1875769858993920:0@lo:502: 00000100:00100000:1.0:1788873657.164135:0:7783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873657.164199:0:7783:0:(client.c:2716:ptlrpc_set_wait()) set 00000000557fc656 going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.164226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858993920 00000100:00100000:0.0:1788873657.164239:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858993920 00000100:00100000:0.0:1788873657.164313:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788873657.164332:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089befeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:7783:x1875769858993920:12345-0@lo:502: 00000100:00100000:0.0:1788873657.164520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089befeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:7783:x1875769858993920:12345-0@lo:502: Request processed in 197us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.164530:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788873657.164813:0:7783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f95542e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7783:1875769858993920:0@lo:502: 00000020:01000000:2.0:1788873657.164859:0:7783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873657.164874:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873657.164877:0:7783:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788873657.164884:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788873657.164888:0:7783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:00000080:2.0:1788873657.164922:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873657.164945:0:7783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b5088ae0) 00000020:00000080:2.0:1788873657.164973:0:7783:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788873657.164980:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788873657.165111:0:7783:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788873657.165120:0:7783:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788873657.165137:0:7783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b305 00010000:00080000:2.0:1788873657.165176:0:7783:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006cf188f3@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:1.0:1788873657.167387:0:7783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788873657.187147:0:7783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788873657.187170:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788873657.187261:0:7783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788873657.187291:0:7783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b30c 00000100:00080000:2.0:1788873657.187306:0:7783:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788873657.187312:0:7783:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000006cf188f3 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873657.187361:0:7783:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a45193b x1875769858994048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873657.187391:0:7783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788873657.187455:0:7783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788873657.187472:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a45193b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769858994048:0@lo:38: 00000100:00100000:3.0:1788873657.187567:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873657.187642:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994048 00000100:00100000:3.0:1788873657.187651:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994048 00000100:00100000:3.0:1788873657.187704:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873657.187711:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b6483a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769858994048:12345-0@lo:38: 00010000:00080000:3.0:1788873657.187740:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:3.0:1788873657.187775:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b313 00000004:00100000:3.0:1788873657.187791:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788873657.187798:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788873657.188028:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee0778e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858994176:0@lo:400: 00000100:00100000:0.0:1788873657.188072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.188095:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873657.188100:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858994304:0@lo:400: 00000100:00100000:0.0:1788873657.188136:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.188156:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873657.188163:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769858994432:0@lo:400: 00000100:00100000:0.0:1788873657.188187:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.188289:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788873657.188301:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788873657.188308:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994176 00000100:00100000:3.0:1788873657.188319:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994176 00000100:00100000:2.0:1788873657.188319:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994432 00000100:00100000:2.0:1788873657.188322:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994432 00000100:00100000:2.0:1788873657.192430:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788873657.192466:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b721ff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769858994432:12345-0@lo:400: 00000100:00100000:2.0:1788873657.192609:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b721ff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769858994432:12345-0@lo:400: Request processed in 162us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.192618:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873657.194475:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788873657.194503:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccbd3630 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858994176:12345-0@lo:400: 00000100:00100000:3.0:1788873657.194641:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccbd3630 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858994176:12345-0@lo:400: Request processed in 154us (6569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873657.194649:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788873657.194757:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ee0778e3 x1875769858994176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873657.194775:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee0778e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858994176:0@lo:400: 00010000:00080000:3.0:1788873657.195893:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006dda03f9 x1875769858994432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873657.195913:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dda03f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769858994432:0@lo:400: 00000100:00100000:3.0:1788873657.197454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994304 00000100:00100000:3.0:1788873657.197470:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994304 00000100:00080000:3.0:1788873657.197645:0:7786:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000cbb38845 x1875769858994560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:2.0:1788873657.197653:0:7783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788873657.197659:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1b56455 going to sleep for 0 seconds 00000020:00000080:2.0:1788873657.197661:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873657.197663:0:7783:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788873657.197666:0:7783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873657.197670:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873657.197672:0:7783:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788873657.197675:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788873657.197677:0:7783:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788873657.197712:0:7783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d3d789d pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7783:1875769858994688:0@lo:502: 00000100:00100000:0.0:1788873657.197811:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788873657.197812:0:7783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.197822:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000987e2dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858994304:12345-0@lo:400: 00000100:00100000:2.0:1788873657.197860:0:7783:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8c8948d going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.197927:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000987e2dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858994304:12345-0@lo:400: Request processed in 98us (9794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.197936:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788873657.197990:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257bda2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858994304:0@lo:400: 00000100:00100000:3.0:1788873657.198166:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994688 00000100:00100000:3.0:1788873657.198172:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994688 00000100:00100000:3.0:1788873657.198232:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788873657.198240:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d0d8a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:7783:x1875769858994688:12345-0@lo:502: 00000100:00100000:2.0:1788873657.198592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d0d8a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:7783:x1875769858994688:12345-0@lo:502: Request processed in 353us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.198601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788873657.199597:0:7783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d3d789d pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:7783:1875769858994688:0@lo:502: 00000020:01000000:0.0:1788873657.199642:0:7783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873657.199651:0:7783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873657.199654:0:7783:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788873657.199658:0:7783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788873657.200341:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788873657.200375:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788873657.200459:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.200487:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000002972acfc/0x25c660afb0a9b2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873657.200500:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788873657.200503:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3480da19c0 from 1 10000000:01000000:2.0:1788873657.200506:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788873657.200549:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.200556:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.200566:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873657.200591:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858994816:0@lo:101: 00000100:00100000:2.0:1788873657.200665:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.200721:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8c8948d going to sleep for 11 seconds 00000100:00100000:3.0:1788873657.200787:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994816 00000100:00100000:3.0:1788873657.200796:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994816 00000100:00100000:0.0:1788873657.201080:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788873657.201091:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b54ec66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858994816:12345-0@lo:101: 00010000:00010000:0.0:1788873657.201107:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873657.201121:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000688a3188/0x25c660afb0a9b321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b31a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.201165:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000688a3188/0x25c660afb0a9b321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.201178:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000688a3188/0x25c660afb0a9b321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873657.201188:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000688a3188, rc 0) 00000100:00100000:0.0:1788873657.201262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b54ec66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858994816:12345-0@lo:101: Request processed in 173us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.201269:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788873657.201324:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858994816:0@lo:101: 00010000:00010000:2.0:1788873657.201340:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.201350:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873657.203587:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858994944:0@lo:501: 00000100:00100000:2.0:1788873657.203683:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.203766:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8c8948d going to sleep for 11 seconds 00000100:00100000:3.0:1788873657.203797:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994944 00000100:00100000:3.0:1788873657.203810:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994944 00000100:00100000:3.0:1788873657.203887:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788873657.203897:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d8cc63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858994944:12345-0@lo:501: 00000100:00100000:3.0:1788873657.204180:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d8cc63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858994944:12345-0@lo:501: Request processed in 284us (497us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788873657.204190:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788873657.205427:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4c9570 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858994944:0@lo:501: 10000000:01000000:2.0:1788873657.205484:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788873657.205496:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873657.205506:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: 000000003079f747/0x25c660afb0a9b31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788873657.208843:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000aadfc272 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873657.208986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b6483a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1875769858994048:12345-0@lo:38: Request processed in 21271us (21416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873657.208999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873657.209044:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873657.209057:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788873657.209067:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788873657.209074:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788873657.209076:0:3632:0:(import.c:65:import_set_state_nolock()) 000000006cf188f3 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788873657.209101:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b1b56455): req@00000000cbb38845 x1875769858994560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873657.209134:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a45193b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769858994048:0@lo:38: 00000100:00100000:3.0:1788873657.209301:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873657.209315:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6faa78b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769858995072:0@lo:41: 00000100:00100000:3.0:1788873657.209378:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.209531:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858995072 00000100:00100000:0.0:1788873657.209540:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858995072 00000100:00100000:0.0:1788873657.209591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788873657.209601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014a434b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769858995072:12345-0@lo:41: 00000004:00000024:0.0:1788873657.209661:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788873657.210039:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014a434b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769858995072:12345-0@lo:41: Request processed in 430us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.210055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788873657.210237:0:7786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.210264:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1b56455 going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.210422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858994560 00000100:00100000:0.0:1788873657.210431:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858994560 00000100:00100000:0.0:1788873657.210480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788873657.210488:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd4c9570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858994560:12345-0@lo:1000: 00000100:00100000:0.0:1788873657.210577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd4c9570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858994560:12345-0@lo:1000: Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.210583:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873657.211701:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6faa78b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769858995072:0@lo:41: 00000100:00100000:2.0:1788873657.213606:0:7786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbb38845 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858994560:0@lo:1000: 00000040:01000000:2.0:1788873657.213675:0:7786:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788873657.213749:0:7786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995200:0@lo:1000: 00000100:00100000:2.0:1788873657.213837:0:7786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.213885:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d305776 going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.213922:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858995200 00000100:00100000:0.0:1788873657.213941:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858995200 00000100:00100000:0.0:1788873657.214017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788873657.214027:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be9e426a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995200:12345-0@lo:1000: 00000100:00100000:0.0:1788873657.214307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be9e426a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995200:12345-0@lo:1000: Request processed in 282us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.214317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788873657.214518:0:7786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995200:0@lo:1000: 00000100:00100000:2.0:1788873657.214580:0:7786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995328:0@lo:700: 00000100:00100000:2.0:1788873657.214618:0:7786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.214645:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8c8948d going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.214682:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858995328 00000100:00100000:0.0:1788873657.214690:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858995328 00000100:00100000:0.0:1788873657.214738:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873657.214746:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087c86a47 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995328:12345-0@lo:700: 00000100:00100000:0.0:1788873657.214806:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087c86a47 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995328:12345-0@lo:700: Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.214814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873657.214849:0:7786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995328:0@lo:700: 00000100:00100000:2.0:1788873657.215085:0:7786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995456:0@lo:1000: 00000100:00100000:2.0:1788873657.215144:0:7786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.215319:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e27d8d44 going to sleep for 11 seconds 00000100:00100000:1.0:1788873657.217623:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858995456 00000100:00100000:1.0:1788873657.217645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858995456 00000100:00100000:0.0:1788873657.217902:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788873657.217916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036da5e8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995456:12345-0@lo:1000: 00000100:00100000:0.0:1788873657.218058:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036da5e8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995456:12345-0@lo:1000: Request processed in 144us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.218066:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873657.218151:0:7786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995456:0@lo:1000: 00000004:00080000:2.0:1788873657.218304:0:7786:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f8c8948d with version 0 00000020:00100000:2.0:1788873657.218336:0:7786:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788873657.218346:0:7786:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d4bab750 x1875769858995712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873657.218369:0:7786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995712:0@lo:1000: 00000100:00100000:2.0:1788873657.218610:0:7786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873657.218641:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858995712 00000100:00100000:3.0:1788873657.218646:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858995712 00000100:00100000:2.0:1788873657.218650:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 000000008659ae5e going to sleep for 11 seconds 00000100:00100000:3.0:1788873657.218701:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788873657.218710:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a45193b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7786:x1875769858995712:12345-0@lo:1000: 00000001:00080000:2.0:1788873657.223047:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788873657.223061:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788873657.225879:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a45193b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7786:x1875769858995712:12345-0@lo:1000: Request processed in 7157us (7257us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788873657.225899:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788873657.225926:0:7786:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788873657.225938:0:7786:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788873657.225961:0:7786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995712:0@lo:1000: 00000100:00100000:2.0:1788873657.226067:0:7786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995840:0@lo:1000: 00000100:00100000:2.0:1788873657.226148:0:7786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873657.226306:0:7786:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df9dbf91 going to sleep for 11 seconds 00000100:00100000:0.0:1788873657.232528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858995840 00000100:00100000:0.0:1788873657.232548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858995840 00000100:00100000:0.0:1788873657.232633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788873657.232644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d3d789d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7786:x1875769858995840:12345-0@lo:1000: 00000100:00100000:0.0:1788873657.232791:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d3d789d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7786:x1875769858995840:12345-0@lo:1000: Request processed in 150us (6643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873657.232799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873657.236655:0:7786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4bab750 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7786:1875769858995840:0@lo:1000: 00000040:00080000:3.0:1788873657.236753:0:7786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788873657.236817:0:7786:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000daa42c66 with version 1 00000004:00080000:0.0:1788873657.236962:0:7784:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000864bcd54 version 1 rpc_version 1 00000020:00100000:0.0:1788873657.237022:0:7784:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788873657.237033:0:7784:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d3281f88 x1875769858996096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873657.237060:0:7784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7784:1875769858996096:0@lo:1000: 00000100:00100000:0.0:1788873657.237397:0:7784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873657.237468:0:7784:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2f7a043 going to sleep for 11 seconds 00000100:00100000:1.0:1788873657.237492:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996096 00000100:00100000:1.0:1788873657.237504:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996096 00000100:00100000:1.0:1788873657.237571:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788873657.237581:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031a905f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7784:x1875769858996096:12345-0@lo:1000: 00000040:00080000:3.0:1788873657.241157:0:7786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000001:00080000:2.0:1788873657.242397:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000004:00080000:3.0:1788873657.242748:0:7786:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788873657.242758:0:7786:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1788873657.242784:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031a905f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7784:x1875769858996096:12345-0@lo:1000: Request processed in 5192us (5375us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788873657.242807:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788873657.246024:0:7784:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788873657.246039:0:7784:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788873657.246074:0:7784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7784:1875769858996096:0@lo:1000: 00010000:00010000:3.0:1788873657.458454:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873658.480877:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873659.506701:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788873660.117290:0:7870:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873660.117520:0:7870:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788873660.145293:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000951c1e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858996224:0@lo:41: 00000100:00100000:3.0:1788873660.145408:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873660.147315:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996224 00000100:00100000:0.0:1788873660.147333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996224 00000100:00100000:0.0:1788873660.147397:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788873660.147409:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8a7321c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858996224:12345-0@lo:41: 00000004:00000024:0.0:1788873660.147458:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788873660.159321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8a7321c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858996224:12345-0@lo:41: Request processed in 11899us (13897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873660.159346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873660.165549:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000951c1e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858996224:0@lo:41: 00010000:00010000:3.0:1788873660.526766:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788873661.545075:0:7918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2786b300 00010000:00010000:2.0:1788873661.551315:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:00000080:3.0:1788873661.551501:0:7918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3476f57c00 uarg=0000000000000000 20000000:01000000:3.0:1788873661.551561:0:7918:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788873661.551571:0:7918:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788873661.551578:0:7918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788873661.551689:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788873661.551705:0:7918:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788873661.560542:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788873661.561569:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788873661.561937:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788873661.561963:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788873661.561987:0:7918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788873661.562011:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.562035:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.562043:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.562059:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.562121:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.562139:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 17 pid: 6503 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873661.562157:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875769858996352:0@lo:104: 00000100:00100000:3.0:1788873661.562270:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873661.562757:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.562767:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873661.562778:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ba8445 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875769858996480:0@lo:104: 00000100:00100000:3.0:1788873661.562803:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set 00000000557fc656 going to sleep for 11 seconds 00000100:00100000:1.0:1788873661.572301:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788873661.572663:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873661.572719:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996352 00000100:00100000:3.0:1788873661.572728:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996480 00000100:00100000:3.0:1788873661.572731:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996480 00000100:00100000:1.0:1788873661.572731:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996352 00000100:00100000:1.0:1788873661.572781:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873661.572790:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003764903d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:7918:x1875769858996352:12345-0@lo:104: 00010000:00010000:1.0:1788873661.573339:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873661.573447:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788873661.573454:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003764903d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:7918:x1875769858996352:12345-0@lo:104: Request processed in 664us (11184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873661.573463:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788873661.573524:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873661.573533:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573557:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002bf666ba already unused, calling callback (00000000ad8b21a9) 10000000:00010000:0.0:1788873661.573562:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573570:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873661.573577:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873661.573583:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873661.573629:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573637:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873661.573659:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573666:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 000000002bf666ba/0x25c660afb0a9b28e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b295 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573680:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873661.573681:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873661.573683:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873661.573709:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858996608:0@lo:103: 00000100:00100000:0.0:1788873661.573754:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873661.573833:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996608 00000100:00100000:0.0:1788873661.573838:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996608 00010000:00010000:0.0:1788873661.573866:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 18 pid: 6503 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873661.573903:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873661.573919:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077b7ee87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3636:x1875769858996608:12345-0@lo:103: 00010000:00010000:0.0:1788873661.573933:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873661.573938:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 18 pid: 6503 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573950:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 18 pid: 6503 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873661.573973:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873661.574000:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077b7ee87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3636:x1875769858996608:12345-0@lo:103: Request processed in 91us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873661.574006:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873661.574060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858996608:0@lo:103: 00010000:00010000:2.0:1788873661.574736:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000251b9b14/0x25c660afb0a9b295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b28e expref: 17 pid: 6503 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873661.574768:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000290864c3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875769858996352:0@lo:104: 00000100:00100000:1.0:1788873661.576129:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873661.576146:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027645354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:7918:x1875769858996480:12345-0@lo:104: 00010000:00010000:1.0:1788873661.576164:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873661.578249:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788873661.578265:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027645354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:7918:x1875769858996480:12345-0@lo:104: Request processed in 2123us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873661.578278:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788873661.578302:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ba8445 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875769858996480:0@lo:104: 00010000:00010000:2.0:1788873661.578342:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578411:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873661.578419:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578428:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000027f06ec5 already unused, calling callback (00000000ad8b21a9) 10000000:00010000:3.0:1788873661.578432:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578467:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873661.578474:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873661.578479:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788873661.578538:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578545:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873661.578584:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578591:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: 0000000027f06ec5/0x25c660afb0a9b1a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b1a7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578611:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873661.578611:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036f97da5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769858996736:0@lo:103: 00010000:00010000:3.0:1788873661.578613:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873661.578615:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873661.578662:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873661.578745:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996736 00000100:00100000:3.0:1788873661.578754:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996736 00010000:00010000:3.0:1788873661.578782:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873661.578825:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788873661.578833:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac11bbc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3633:x1875769858996736:12345-0@lo:103: 00010000:00010000:3.0:1788873661.578847:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873661.578852:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578871:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578885:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070c63fb7/0x25c660afb0a9b1a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b1a0 expref: 17 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578902:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578910:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578928:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578935:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578941:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578947:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578952:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030b3b560 already unused, calling callback (00000000356f5322) 00010000:00010000:3.0:1788873661.578956:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578964:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.578993:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873661.579003:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873661.579046:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac11bbc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3633:x1875769858996736:12345-0@lo:103: Request processed in 214us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873661.579053:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873661.579123:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036f97da5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769858996736:0@lo:103: 00010000:00010000:2.0:1788873661.579147:0:7918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873661.579155:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873661.579161:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030b3b560/0x25c660afb0a9b328 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873662.191480:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5029df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858996992:0@lo:400: 00000100:00100000:0.0:1788873662.191616:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873662.191699:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873662.191706:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acd8c1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858997120:0@lo:400: 00000100:00100000:0.0:1788873662.191735:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873662.191790:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996992 00000100:00100000:1.0:1788873662.191992:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858996864:0@lo:400: 00000100:00100000:1.0:1788873662.192038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873662.192075:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769858997376:0@lo:400: 00000100:00100000:1.0:1788873662.192144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873662.192165:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873662.192171:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000951c1e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769858997248:0@lo:400: 00000100:00100000:1.0:1788873662.192198:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873662.192245:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997120 00000100:00100000:1.0:1788873662.192252:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997120 00000100:00100000:1.0:1788873662.192299:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997376 00000100:00100000:1.0:1788873662.192302:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997376 00000100:00100000:1.0:1788873662.192318:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788873662.192326:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000257bda2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858997120:12345-0@lo:400: 00000100:00100000:2.0:1788873662.194320:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788873662.194350:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000107ecc3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769858997376:12345-0@lo:400: 00000100:00100000:1.0:1788873662.194552:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000257bda2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858997120:12345-0@lo:400: Request processed in 2225us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873662.194562:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788873662.194718:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996992 00000100:00100000:2.0:1788873662.194946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000107ecc3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769858997376:12345-0@lo:400: Request processed in 612us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873662.194954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788873662.194989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997248 00000100:00100000:2.0:1788873662.194996:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997248 00000100:00100000:2.0:1788873662.195037:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788873662.195043:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acd91f81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769858997248:12345-0@lo:400: 00000100:00100000:2.0:1788873662.195073:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acd91f81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769858997248:12345-0@lo:400: Request processed in 31us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873662.195090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788873662.195919:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788873662.195934:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6faa78b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858996992:12345-0@lo:400: 00000100:00100000:0.0:1788873662.196000:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6faa78b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769858996992:12345-0@lo:400: Request processed in 72us (4385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873662.196015:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788873662.196096:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acd8c1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858997120:0@lo:400: 00010000:00080000:0.0:1788873662.196116:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e5029df2 x1875769858996992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873662.196127:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5029df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769858996992:0@lo:400: 00000100:00100000:0.0:1788873662.196195:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858996864 00000100:00100000:0.0:1788873662.196201:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858996864 00000100:00100000:0.0:1788873662.196256:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788873662.196262:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf75cdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3634:x1875769858996864:12345-0@lo:400: 00000100:00100000:0.0:1788873662.196299:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf75cdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3634:x1875769858996864:12345-0@lo:400: Request processed in 38us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873662.196305:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788873662.196380:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000951c1e30 x1875769858997248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873662.196391:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000951c1e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769858997248:0@lo:400: 00000100:00100000:0.0:1788873662.196403:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1329d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858996864:0@lo:400: 00000100:00100000:0.0:1788873662.196413:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769858997376:0@lo:400: 00010000:00010000:0.0:1788873662.578759:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873662.703686:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873662.703797:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8a5def1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769858997504:0@lo:41: 00000100:00100000:3.0:1788873662.703902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873662.704424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997504 00000100:00100000:1.0:1788873662.704437:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997504 00000100:00100000:1.0:1788873662.704524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788873662.704536:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b97958bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769858997504:12345-0@lo:41: 00000004:00000024:1.0:1788873662.705748:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788873662.705862:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b97958bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769858997504:12345-0@lo:41: Request processed in 1326us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873662.705873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873662.706061:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8a5def1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769858997504:0@lo:41: 00010000:00010000:2.0:1788873663.599286:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873664.624609:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873665.263465:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769858997632:0@lo:41: 00000100:00100000:3.0:1788873665.263547:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873665.263748:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997632 00000100:00100000:0.0:1788873665.263758:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997632 00000100:00100000:0.0:1788873665.263812:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788873665.263821:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c65e3c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769858997632:12345-0@lo:41: 00000004:00000024:0.0:1788873665.263860:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788873665.263912:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c65e3c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769858997632:12345-0@lo:41: Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873665.263951:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788873665.264001:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769858997632:0@lo:41: 00010000:00010000:1.0:1788873665.647978:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788873666.286430:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788873666.286438:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34651cb800 from 1 10000000:01000000:2.0:1788873666.286443:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788873666.286491:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: 000000006681f9ba/0x25c660afb0a9b32f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873666.286502:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: 000000006681f9ba/0x25c660afb0a9b32f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873666.286512:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: 000000006681f9ba/0x25c660afb0a9b32f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873666.286602:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858997760:0@lo:101: 00000100:00100000:2.0:1788873666.286674:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873666.286779:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069bd4491 going to sleep for 11 seconds 00000100:00100000:1.0:1788873666.303496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997760 00000100:00100000:1.0:1788873666.303514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997760 00000100:00100000:1.0:1788873666.303601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788873666.303610:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e6d4837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769858997760:12345-0@lo:101: 00010000:00010000:1.0:1788873666.303628:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873666.303657:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040a1c314/0x25c660afb0a9b336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b32f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873666.303685:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040a1c314/0x25c660afb0a9b336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873666.303697:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040a1c314/0x25c660afb0a9b336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873666.303705:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040a1c314, rc 0) 00000100:00100000:1.0:1788873666.303768:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e6d4837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858997760:12345-0@lo:101: Request processed in 160us (17095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873666.303772:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788873666.303825:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd45539d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858997760:0@lo:101: 00010000:00010000:1.0:1788873666.303839:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: 000000006681f9ba/0x25c660afb0a9b32f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873666.303846:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: 000000006681f9ba/0x25c660afb0a9b32f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873666.303911:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072e58491 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858997888:0@lo:501: 00000100:00100000:1.0:1788873666.303935:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873666.303957:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069bd4491 going to sleep for 11 seconds 00000100:00100000:1.0:1788873666.303966:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858997888 00000100:00100000:1.0:1788873666.303968:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858997888 00000100:00100000:1.0:1788873666.303983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788873666.303986:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce72d7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858997888:12345-0@lo:501: 00000100:00100000:1.0:1788873666.304098:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce72d7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858997888:12345-0@lo:501: Request processed in 110us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873666.304114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788873666.304144:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072e58491 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858997888:0@lo:501: 00000100:00100000:1.0:1788873666.304168:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072e58491 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998016:0@lo:503: 00000100:00100000:1.0:1788873666.304225:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873666.304239:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069bd4491 going to sleep for 11 seconds 00000100:00100000:1.0:1788873666.304250:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998016 00000100:00100000:1.0:1788873666.304253:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998016 00000100:00100000:1.0:1788873666.304269:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788873666.304273:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e948b2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858998016:12345-0@lo:503: 00000100:00100000:1.0:1788873666.309961:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e948b2d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858998016:12345-0@lo:503: Request processed in 5678us (5727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873666.309977:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788873666.309996:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072e58491 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998016:0@lo:503: 00000100:00100000:0.0:1788873666.310954:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8107:1875769858998144:0@lo:502: 00000100:00100000:0.0:1788873666.311015:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873666.311056:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fe38f6c going to sleep for 11 seconds 00000100:00100000:3.0:1788873666.311104:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998144 00000100:00100000:3.0:1788873666.311111:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998144 00000100:00100000:3.0:1788873666.311158:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788873666.311168:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf7870fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8107:x1875769858998144:12345-0@lo:502: 00000100:00100000:3.0:1788873666.311307:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf7870fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8107:x1875769858998144:12345-0@lo:502: Request processed in 132us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873666.311315:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788873666.311446:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3281f88 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8107:1875769858998144:0@lo:502: 00000020:01000000:0.0:1788873666.311471:0:8107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873666.311480:0:8107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873666.311483:0:8107:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788873666.311492:0:8107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d34651cb800 00000020:00000080:0.0:1788873666.311494:0:8107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788873666.311542:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8107:1875769858998272:0@lo:502: 00000100:00100000:0.0:1788873666.311576:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873666.311599:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873666.311835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998272 00000100:00100000:3.0:1788873666.311840:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998272 00000100:00100000:3.0:1788873666.311876:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788873666.311884:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8107:x1875769858998272:12345-0@lo:502: 00000100:00100000:3.0:1788873666.311952:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8107:x1875769858998272:12345-0@lo:502: Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873666.311968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788873666.312418:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8107:1875769858998272:0@lo:502: 00000020:01000000:0.0:1788873666.312444:0:8107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873666.312449:0:8107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873666.312451:0:8107:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788873666.312456:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788873666.321748:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788873666.321798:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873666.321813:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.321829:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873666.321841:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788873666.321844:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34473c7800 from 1 10000000:01000000:3.0:1788873666.321846:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788873666.321890:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.321897:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.321908:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873666.321933:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998400:0@lo:101: 00000100:00100000:3.0:1788873666.322005:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873666.322064:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998400 00000100:00100000:3.0:1788873666.322073:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998400 00000100:00100000:3.0:1788873666.323579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788873666.323598:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769858998400:12345-0@lo:101: 00010000:00010000:3.0:1788873666.323618:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873666.323638:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b33d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.323679:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.323691:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.323702:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d34821dda00, rc 0) 00000100:00100000:3.0:1788873666.323767:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858998400:12345-0@lo:101: Request processed in 177us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873666.323775:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788873666.327796:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788873666.327843:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998400:0@lo:101: 00010000:00010000:3.0:1788873666.327871:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.327883:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873666.327967:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998528:0@lo:501: 00000100:00100000:3.0:1788873666.328031:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873666.328079:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788873666.328652:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998528 00000100:00100000:1.0:1788873666.328659:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998528 00000100:00100000:1.0:1788873666.328705:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788873666.328715:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858998528:12345-0@lo:501: 00000100:00100000:1.0:1788873666.328843:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858998528:12345-0@lo:501: Request processed in 129us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873666.328850:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788873666.330070:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998528:0@lo:501: 00000100:00100000:3.0:1788873666.330119:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998656:0@lo:503: 00000100:00100000:3.0:1788873666.330176:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873666.330233:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873666.330372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998656 00000100:00100000:2.0:1788873666.330378:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998656 00000100:00100000:2.0:1788873666.330478:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788873666.330488:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858998656:12345-0@lo:503: 00000100:00100000:2.0:1788873666.330711:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769858998656:12345-0@lo:503: Request processed in 224us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873666.330719:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788873666.331158:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769858998656:0@lo:503: 00000100:00100000:2.0:1788873666.334028:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8111:1875769858998784:0@lo:502: 00000100:00100000:2.0:1788873666.334138:0:8111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873666.334189:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a4c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788873666.334340:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998784 00000100:00100000:3.0:1788873666.334348:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998784 00000100:00100000:3.0:1788873666.334399:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788873666.334409:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8111:x1875769858998784:12345-0@lo:502: 00000100:00100000:3.0:1788873666.334759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8111:x1875769858998784:12345-0@lo:502: Request processed in 350us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873666.334767:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788873666.342612:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8111:1875769858998784:0@lo:502: 00000020:01000000:2.0:1788873666.353130:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873666.353146:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873666.353148:0:8111:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788873666.353156:0:8111:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d34473c7800 00000020:00000080:2.0:1788873666.353159:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788873666.353241:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8111:1875769858998912:0@lo:502: 00000100:00100000:2.0:1788873666.353331:0:8111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873666.353377:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a4c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788873666.354096:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858998912 00000100:00100000:3.0:1788873666.354107:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858998912 00000100:00100000:3.0:1788873666.354166:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788873666.354175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8111:x1875769858998912:12345-0@lo:502: 00000100:00100000:3.0:1788873666.354428:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8111:x1875769858998912:12345-0@lo:502: Request processed in 253us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873666.354436:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788873666.354549:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8111:1875769858998912:0@lo:502: 00000020:01000000:2.0:1788873666.354575:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873666.354580:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873666.354582:0:8111:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788873666.354586:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788873666.354769:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788873666.354790:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873666.354801:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873666.354813:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873666.671425:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873667.318436:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769858999168:0@lo:400: 00000100:00100000:3.0:1788873667.318508:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873667.318572:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788873667.318579:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858999040:0@lo:400: 00000100:00100000:3.0:1788873667.318609:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873667.318650:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769858999552:0@lo:400: 00000100:00100000:3.0:1788873667.318686:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873667.318715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858999296:0@lo:400: 00000100:00100000:3.0:1788873667.318740:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873667.318759:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873667.318764:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769858999424:0@lo:400: 00000100:00100000:3.0:1788873667.318785:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873667.318815:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999168 00000100:00100000:3.0:1788873667.318822:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999168 00000100:00100000:3.0:1788873667.318863:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999424 00000100:00100000:3.0:1788873667.318866:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999424 00000100:00100000:3.0:1788873667.318883:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873667.318891:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769858999168:12345-0@lo:400: 00000100:00100000:3.0:1788873667.318943:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769858999168:12345-0@lo:400: Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873667.318950:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873667.318965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873667.318971:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769858999424:12345-0@lo:400: 00000100:00100000:3.0:1788873667.319000:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769858999424:12345-0@lo:400: Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873667.319006:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873667.319022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999040 00000100:00100000:3.0:1788873667.319025:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999040 00000100:00100000:2.0:1788873667.320513:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999552 00000100:00100000:2.0:1788873667.320535:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999552 00000100:00100000:2.0:1788873667.320590:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999296 00000100:00100000:2.0:1788873667.320594:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999296 00000100:00100000:2.0:1788873667.320611:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788873667.320619:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769858999552:12345-0@lo:400: 00000100:00100000:2.0:1788873667.320698:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769858999552:12345-0@lo:400: Request processed in 80us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873667.320718:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788873667.320742:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788873667.320749:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858999296:12345-0@lo:400: 00000100:00100000:2.0:1788873667.320778:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858999296:12345-0@lo:400: Request processed in 30us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873667.320784:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788873667.321713:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788873667.321721:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3634:x1875769858999040:12345-0@lo:400: 00000100:00100000:3.0:1788873667.321764:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3634:x1875769858999040:12345-0@lo:400: Request processed in 44us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873667.321781:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788873667.321848:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475d93b80 x1875769858999424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873667.321863:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769858999424:0@lo:400: 00000100:00100000:3.0:1788873667.321877:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858999296:0@lo:400: 00000100:00100000:3.0:1788873667.321911:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769858999040:0@lo:400: 00000100:00100000:3.0:1788873667.321922:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769858999552:0@lo:400: 00010000:00080000:3.0:1788873667.321935:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475d90000 x1875769858999168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873667.321944:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769858999168:0@lo:400: 00010000:00010000:2.0:1788873667.695330:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873667.823902:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769858999680:0@lo:41: 00000100:00100000:1.0:1788873667.823981:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873667.824243:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999680 00000100:00100000:3.0:1788873667.824262:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999680 00000100:00100000:2.0:1788873667.846174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788873667.846201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769858999680:12345-0@lo:41: 00000004:00000024:2.0:1788873667.846278:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788873667.846378:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769858999680:12345-0@lo:41: Request processed in 190us (22399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873667.846398:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788873667.846461:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769858999680:0@lo:41: 00010000:00010000:2.0:1788873668.718376:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873669.745752:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873670.382435:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858999808:0@lo:41: 00000100:00100000:3.0:1788873670.382520:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873670.382696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999808 00000100:00100000:0.0:1788873670.382705:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999808 00000100:00100000:0.0:1788873670.382795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788873670.382807:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858999808:12345-0@lo:41: 00000004:00000024:0.0:1788873670.382842:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788873670.382897:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769858999808:12345-0@lo:41: Request processed in 92us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873670.382911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788873670.383933:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769858999808:0@lo:41: 00010000:00010000:2.0:1788873670.767796:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873671.796508:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873672.430637:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859000064:0@lo:400: 00000100:00100000:3.0:1788873672.430713:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873672.430776:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873672.430783:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859000192:0@lo:400: 00000100:00100000:3.0:1788873672.430810:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873672.430861:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000064 00000100:00100000:3.0:1788873672.430869:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000064 00000100:00100000:3.0:1788873672.430915:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873672.430937:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859000064:12345-0@lo:400: 00000100:00100000:3.0:1788873672.431002:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859000064:12345-0@lo:400: Request processed in 67us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873672.431009:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788873672.431052:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475ef8380 x1875769859000064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873672.431066:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859000064:0@lo:400: 00000100:00100000:1.0:1788873672.431193:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858999936:0@lo:400: 00000100:00100000:1.0:1788873672.431271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873672.431307:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859000448:0@lo:400: 00000100:00100000:1.0:1788873672.431331:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873672.431349:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873672.431355:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859000320:0@lo:400: 00000100:00100000:1.0:1788873672.431375:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873672.431401:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000192 00000100:00100000:1.0:1788873672.431405:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000192 00000100:00100000:1.0:1788873672.431431:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000448 00000100:00100000:1.0:1788873672.431433:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000448 00000100:00100000:1.0:1788873672.431446:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788873672.431451:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859000192:12345-0@lo:400: 00000100:00100000:1.0:1788873672.431501:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859000192:12345-0@lo:400: Request processed in 48us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873672.431507:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788873672.431520:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788873672.431526:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859000448:12345-0@lo:400: 00000100:00100000:1.0:1788873672.431557:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859000448:12345-0@lo:400: Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873672.431563:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788873672.431579:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000320 00000100:00100000:1.0:1788873672.431582:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000320 00000100:00100000:1.0:1788873672.431605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873672.431610:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859000320:12345-0@lo:400: 00000100:00100000:1.0:1788873672.431639:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859000320:12345-0@lo:400: Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873672.431645:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788873672.431672:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475ef8e00 x1875769859000320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873672.431694:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859000320:0@lo:400: 00000100:00100000:1.0:1788873672.431706:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859000448:0@lo:400: 00000100:00100000:3.0:1788873672.432024:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769858999936 00000100:00100000:3.0:1788873672.432029:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769858999936 00000100:00100000:3.0:1788873672.432057:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788873672.432064:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3636:x1875769858999936:12345-0@lo:400: 00000100:00100000:3.0:1788873672.432112:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3636:x1875769858999936:12345-0@lo:400: Request processed in 49us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873672.432119:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788873672.432157:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859000192:0@lo:400: 00000100:00100000:1.0:1788873672.434448:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769858999936:0@lo:400: 00010000:00010000:3.0:1788873672.819582:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873672.942547:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859000576:0@lo:41: 00000100:00100000:3.0:1788873672.942634:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873672.942717:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000576 00000100:00100000:3.0:1788873672.942725:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000576 00000100:00100000:3.0:1788873672.942775:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788873672.942783:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859000576:12345-0@lo:41: 00000004:00000024:3.0:1788873672.942817:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788873672.942864:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859000576:12345-0@lo:41: Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873672.942871:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788873672.942926:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859000576:0@lo:41: 00000020:01000004:3.0:1788873673.029649:0:8418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788873673.029653:0:8418:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788873673.029655:0:8418:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788873673.029789:0:8418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3476df3800 00000020:01000004:3.0:1788873673.029809:0:8418:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788873673.029822:0:8418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788873673.029847:0:8418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d347a790000) 00000020:00000080:3.0:1788873673.029863:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788873673.105781:0:8418:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788873673.105848:0:8418:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788873673.161607:0:8418:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788873673.161832:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788873673.161847:0:8418:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788873673.161860:0:8418:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c660afb0a9b352 00000020:01000004:1.0:1788873673.161868:0:8418:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788873673.161889:0:8418:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788873673.161893:0:8418:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788873673.161898:0:8418:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788873673.161904:0:8418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788873673.161915:0:8418:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d3480da3380) 00000020:00000080:1.0:1788873673.161926:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1788873673.175200:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873673.175453:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788873673.175463:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788873673.176681:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788873673.176691:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788873673.177996:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788873673.178012:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788873673.201796:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873673.201999:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788873673.202006:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788873673.204987:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788873673.205007:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788873673.279091:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873673.279601:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788873673.279608:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788873673.282763:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788873673.282779:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788873673.287127:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788873673.287146:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788873673.294078:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873673.295183:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788873673.295224:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788873673.296178:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788873673.296196:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788873673.391455:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873673.392697:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788873673.392706:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788873673.395392:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788873673.395409:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788873673.396420:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788873673.396454:0:8418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788873673.396472:0:8418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788873673.454727:0:8418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788873673.454766:0:8418:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.120@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788873673.454770:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788873673.454772:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788873673.454774:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873673.454775:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873673.454776:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873673.454777:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873673.454779:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873673.454780:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788873673.454782:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788873673.454783:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873673.454784:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788873673.454788:0:8418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788873673.454790:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788873673.454792:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788873673.454793:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873673.454794:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873673.454800:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873673.454801:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873673.454802:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873673.454803:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788873673.454804:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788873673.454805:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873673.454806:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788873673.454833:0:8418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788873673.454852:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859000704:0@lo:253: 00000100:00100000:3.0:1788873673.458487:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.458620:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52780 going to sleep for 11 seconds 00000100:00100000:0.0:1788873673.458681:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000704 00000100:00100000:0.0:1788873673.458690:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000704 00000100:00100000:0.0:1788873673.458770:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788873673.458783:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8418:x1875769859000704:12345-0@lo:253: 20000000:01000000:0.0:1788873673.458847:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788873673.458852:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788873673.458858:0:6503:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788873673.458861:0:6503:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788873673.459368:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873673.459845:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788873673.459864:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788873673.459885:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788873673.459891:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788873673.459906:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788873673.460006:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788873673.460415:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788873673.460439:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.120@tcp 20000000:01000000:0.0:1788873673.460441:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788873673.460461:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788873673.460467:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788873673.460481:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788873673.460487:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:0.0:1788873673.460500:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788873673.460527:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788873673.460543:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788873673.462736:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788873673.462869:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788873673.462891:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.120@tcp 20000000:01000000:0.0:1788873673.462893:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788873673.462909:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788873673.463891:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788873673.464159:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788873673.464172:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:0.0:1788873673.464200:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788873673.464336:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788873673.464358:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788873673.464375:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788873673.467878:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788873673.468816:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.120@tcp 20000000:01000000:0.0:1788873673.468822:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788873673.468872:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788873673.468888:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788873673.468905:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788873673.468911:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:0.0:1788873673.469062:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788873673.469072:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788873673.469087:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788873673.469103:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788873673.469123:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788873673.469126:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788873673.469130:0:6503:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788873673.469181:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788873673.469185:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788873673.472413:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788873673.472482:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788873673.472501:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788873673.477781:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788873673.477840:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788873673.477856:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788873673.477868:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788873673.477870:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788873673.481248:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788873673.481703:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788873673.481745:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788873673.481763:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788873673.481777:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788873673.481780:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788873673.482654:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788873673.482695:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788873673.482712:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788873673.486091:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788873673.486129:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788873673.486147:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788873673.486158:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788873673.486161:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788873673.486994:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788873673.487166:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788873673.487373:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788873673.487628:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788873673.487647:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788873673.487662:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1788873673.487679:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788873673.487700:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.487828:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.487838:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.487845:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.487852:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.487860:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.487867:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.488117:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.488149:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 18 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.488165:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859000832:0@lo:104: 00000100:00100000:1.0:1788873673.488609:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873673.488661:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.488671:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 18 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.488679:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859000960:0@lo:104: 00000100:00100000:1.0:1788873673.488700:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873673.488733:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.488743:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 18 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.488752:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859001088:0@lo:104: 00000100:00100000:1.0:1788873673.488771:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873673.488787:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.488794:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 18 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.488801:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859001216:0@lo:104: 00000100:00100000:1.0:1788873673.488829:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873673.488845:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.488853:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 18 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.488860:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859001344:0@lo:104: 00000100:00100000:1.0:1788873673.488879:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.488889:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873673.488954:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000832 00000100:00100000:3.0:1788873673.488962:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000832 00000100:00100000:3.0:1788873673.489012:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859000960 00000100:00100000:3.0:1788873673.489016:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859000960 00000100:00100000:3.0:1788873673.489026:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001088 00000100:00100000:3.0:1788873673.489029:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001088 00000100:00100000:3.0:1788873673.489038:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001216 00000100:00100000:3.0:1788873673.489040:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001216 00000100:00100000:3.0:1788873673.489047:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001344 00000100:00100000:3.0:1788873673.489050:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001344 00000100:00100000:3.0:1788873673.489062:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873673.489070:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6503:x1875769859000832:12345-0@lo:104: 00010000:00010000:3.0:1788873673.489084:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489145:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788873673.489152:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6503:x1875769859000832:12345-0@lo:104: Request processed in 82us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.489158:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873673.489175:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873673.489180:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6503:x1875769859000960:12345-0@lo:104: 00010000:00010000:3.0:1788873673.489238:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489274:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788873673.489280:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6503:x1875769859000960:12345-0@lo:104: Request processed in 100us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.489286:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873673.489298:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873673.489304:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6503:x1875769859001088:12345-0@lo:104: 00010000:00010000:3.0:1788873673.489311:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489351:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788873673.489356:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6503:x1875769859001088:12345-0@lo:104: Request processed in 53us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.489363:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873673.489375:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873673.489380:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6503:x1875769859001216:12345-0@lo:104: 00010000:00010000:3.0:1788873673.489387:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489408:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788873673.489413:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6503:x1875769859001216:12345-0@lo:104: Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.489418:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873673.489427:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788873673.489432:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6503:x1875769859001344:12345-0@lo:104: 00010000:00010000:3.0:1788873673.489445:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489484:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788873673.489489:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6503:x1875769859001344:12345-0@lo:104: Request processed in 57us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.489495:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788873673.489513:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788873673.489519:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489525:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ea00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873673.489529:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489536:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873673.489543:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873673.489548:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873673.489577:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489584:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873673.489600:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489607:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215ea00/0x25c660afb0a9b31a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489626:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788873673.489630:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489635:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93200 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873673.489638:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489645:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873673.489652:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873673.489657:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873673.489672:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489678:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873673.489691:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489698:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93200/0x25c660afb0a9b2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489707:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788873673.489710:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489725:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e200 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873673.489728:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489735:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873673.489741:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873673.489745:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873673.489759:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489764:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873673.489770:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489776:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489784:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788873673.489787:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489793:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873673.489796:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489813:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873673.489819:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873673.489824:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873673.489838:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489843:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873673.489848:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489854:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2a3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489863:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873673.489865:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489871:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfebc00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873673.489874:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489880:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873673.489887:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873673.489905:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873673.489918:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489923:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873673.489928:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489934:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b22c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.489948:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873673.489950:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873673.489951:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873673.489985:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859001472:0@lo:103: 00000100:00100000:3.0:1788873673.490020:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.490048:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859001984:0@lo:103: 00000100:00100000:3.0:1788873673.490067:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.490087:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873673.490093:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859001856:0@lo:103: 00000100:00100000:3.0:1788873673.490113:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.490139:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001472 00000100:00100000:3.0:1788873673.490143:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001472 00010000:00010000:3.0:1788873673.490177:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 19 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873673.490194:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001984 00000100:00100000:3.0:1788873673.490196:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001984 00010000:00010000:3.0:1788873673.490241:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 20 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873673.490253:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001856 00000100:00100000:3.0:1788873673.490255:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001856 00010000:00010000:3.0:1788873673.490265:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 21 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873673.490276:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873673.490281:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3634:x1875769859001472:12345-0@lo:103: 00010000:00010000:3.0:1788873673.490291:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873673.490296:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 21 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490307:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 21 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490323:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873673.490353:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3634:x1875769859001472:12345-0@lo:103: Request processed in 72us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.490359:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873673.490372:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873673.490377:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3634:x1875769859001984:12345-0@lo:103: 00010000:00010000:3.0:1788873673.490385:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873673.490389:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 20 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490396:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 20 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490417:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873673.490439:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3634:x1875769859001984:12345-0@lo:103: Request processed in 62us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.490445:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873673.490455:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873673.490461:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3634:x1875769859001856:12345-0@lo:103: 00010000:00010000:3.0:1788873673.490467:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873673.490471:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 19 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490479:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 19 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490487:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873673.490503:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3634:x1875769859001856:12345-0@lo:103: Request processed in 43us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.490509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873673.490538:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859001856:0@lo:103: 00000100:00100000:3.0:1788873673.490547:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859001472:0@lo:103: 00000100:00100000:3.0:1788873673.490553:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859001984:0@lo:103: 00000100:00100000:3.0:1788873673.490599:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859001600:0@lo:103: 00000100:00100000:3.0:1788873673.490621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.490643:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873673.490648:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859001728:0@lo:103: 00000100:00100000:3.0:1788873673.490668:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873673.490691:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873673.490698:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001600 00000100:00100000:3.0:1788873673.490702:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001600 00010000:00010000:3.0:1788873673.490715:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 19 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873673.490728:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859001728 00000100:00100000:3.0:1788873673.490730:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859001728 00010000:00010000:3.0:1788873673.490739:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 20 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873673.490751:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873673.490756:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3635:x1875769859001600:12345-0@lo:103: 00010000:00010000:3.0:1788873673.490763:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873673.490767:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 20 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490776:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 20 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490786:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873673.490811:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3635:x1875769859001600:12345-0@lo:103: Request processed in 55us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.490817:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873673.490828:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788873673.490834:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458495050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3635:x1875769859001728:12345-0@lo:103: 00010000:00010000:3.0:1788873673.490841:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873673.490845:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 19 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490864:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 19 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490876:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490885:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490898:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490905:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490912:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490919:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490925:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfeb600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873673.490929:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490937:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490945:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.490964:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873673.491000:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458495050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3635:x1875769859001728:12345-0@lo:103: Request processed in 166us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.491006:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788873673.491049:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859001728:0@lo:103: 00000100:00100000:3.0:1788873673.491058:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859001600:0@lo:103: 00010000:00010000:1.0:1788873673.491692:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93a00/0x25c660afb0a9b321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b31a expref: 18 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.491707:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859000832:0@lo:104: 00010000:00010000:1.0:1788873673.491728:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b2f0 expref: 17 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.491738:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859000960:0@lo:104: 00010000:00010000:1.0:1788873673.491748:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b2d4 expref: 16 pid: 6505 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.491756:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859001088:0@lo:104: 00010000:00010000:1.0:1788873673.491763:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215e400/0x25c660afb0a9b2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b29c expref: 15 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.491770:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859001216:0@lo:104: 00010000:00010000:1.0:1788873673.491778:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b225 expref: 14 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.491802:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1875769859001344:0@lo:104: 00010000:00010000:1.0:1788873673.491825:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.491834:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.491840:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.491846:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeb600/0x25c660afb0a9b360 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788873673.491859:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788873673.495373:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:8418:x1875769859000704:12345-0@lo:253: Request processed in 36583us (36886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873673.495388:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788873673.495663:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859000704:0@lo:253: 10000000:01000000:3.0:1788873673.495679:0:8418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788873673.495683:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788873673.495684:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788873673.495686:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873673.495687:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788873673.495689:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873673.495690:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873673.495692:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873673.495693:0:8418:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788873673.495695:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873673.495696:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788873673.495772:0:8418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3476df3800 from lustre-OST0000 10000000:01000000:3.0:1788873673.495807:0:8418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788873673.495810:0:8418:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788873673.495818:0:8418:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3480da19c0 local copy 10000000:01000000:3.0:1788873673.495822:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788873673.495861:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.495874:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.495885:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873673.496011:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002112:0@lo:101: 00000100:00100000:3.0:1788873673.496061:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.496144:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788873673.496380:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002112 00000100:00100000:0.0:1788873673.496388:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002112 00000100:00100000:0.0:1788873673.496534:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788873673.496545:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+13:8418:x1875769859002112:12345-0@lo:101: 00010000:00010000:0.0:1788873673.496569:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873673.496583:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b36e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b367 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.496609:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b367 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.496621:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b367 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.496630:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93e00, rc 0) 00000100:00100000:0.0:1788873673.496730:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002112:12345-0@lo:101: Request processed in 187us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.496738:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788873673.496933:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002112:0@lo:101: 00010000:00010000:2.0:1788873673.496949:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.496959:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.497075:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002240:0@lo:501: 00000100:00100000:2.0:1788873673.497108:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.497173:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458873300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873673.497412:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002240 00000100:00100000:0.0:1788873673.497418:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002240 00000100:00100000:0.0:1788873673.497454:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788873673.497618:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002240:12345-0@lo:501: 00000100:00100000:0.0:1788873673.497686:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002240:12345-0@lo:501: Request processed in 224us (577us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788873673.497693:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788873673.497839:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002240:0@lo:501: 10000000:01000000:2.0:1788873673.497867:0:8418:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788873673.497888:0:8418:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788873673.497900:0:8418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.497909:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.497993:0:8418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.498015:0:8418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788873673.498040:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3476df3800 10000000:01000000:2.0:1788873673.498045:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788873673.498050:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788873673.498053:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788873673.498058:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788873673.498061:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788873673.498082:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.498091:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.498098:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.498114:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002368:0@lo:101: 00000100:00100000:2.0:1788873673.498142:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.498171:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873673.499790:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002368 00000100:00100000:0.0:1788873673.499804:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002368 00000100:00100000:0.0:1788873673.499858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788873673.499868:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002368:12345-0@lo:101: 00010000:00010000:0.0:1788873673.499883:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873673.499900:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b375 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.500052:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.500065:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.500074:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92600, rc 0) 00000100:00100000:0.0:1788873673.500136:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859002368:12345-0@lo:101: Request processed in 271us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.500143:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788873673.500366:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002368:0@lo:101: 00010000:00010000:2.0:1788873673.500384:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.500400:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.500636:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002496:0@lo:501: 00000100:00100000:2.0:1788873673.500673:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.500712:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a900 going to sleep for 11 seconds 00010000:00010000:3.0:1788873673.500874:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873673.500882:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.500890:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dd600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873673.500894:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.500904:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873673.500911:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873673.501003:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873673.501028:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.501035:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873673.501065:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.501073:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b36e expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.501102:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873673.501112:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873673.501115:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873673.501160:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002496 00000100:00100000:0.0:1788873673.501165:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002496 00000100:00100000:0.0:1788873673.501344:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788873673.501355:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859002496:12345-0@lo:501: 00000100:00100000:2.0:1788873673.501653:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859002624:0@lo:103: 00000100:00100000:2.0:1788873673.501692:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.501789:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002624 00000100:00100000:3.0:1788873673.501793:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002624 00000100:00100000:3.0:1788873673.501831:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788873673.501838:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3635:x1875769859002624:12345-0@lo:103: 00010000:00010000:3.0:1788873673.501851:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873673.501868:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b36e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b367 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873673.501884:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873673.501912:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3635:x1875769859002624:12345-0@lo:103: Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.502028:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873673.502098:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002496:12345-0@lo:501: Request processed in 745us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.502105:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788873673.502288:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859002624:0@lo:103: 00000100:00100000:3.0:1788873673.502381:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002496:0@lo:501: 00000100:00100000:3.0:1788873673.502415:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002752:0@lo:503: 00000100:00100000:3.0:1788873673.502459:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.502637:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.502687:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002752 00000100:00100000:2.0:1788873673.502692:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002752 00000100:00100000:2.0:1788873673.502905:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788873673.502914:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002752:12345-0@lo:503: 00000100:00100000:2.0:1788873673.503426:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002752:12345-0@lo:503: Request processed in 512us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.503434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788873673.503667:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002752:0@lo:503: 00000040:00080000:3.0:1788873673.504036:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873673.504135:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002880:0@lo:502: 00000100:00100000:3.0:1788873673.504198:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.504306:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873673.504541:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859002880 00000100:00100000:1.0:1788873673.504615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859002880 00000100:00100000:1.0:1788873673.504704:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788873673.504713:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002880:12345-0@lo:502: 00000100:00100000:1.0:1788873673.504833:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859002880:12345-0@lo:502: Request processed in 122us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873673.504841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788873673.504929:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859002880:0@lo:502: 00000040:00080000:3.0:1788873673.505173:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788873673.505242:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788873673.505258:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788873673.505284:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788873673.505300:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788873673.505314:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788873673.505336:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003008:0@lo:502: 00000100:00100000:3.0:1788873673.505377:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.506055:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344ce52840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.506118:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003008 00000100:00100000:2.0:1788873673.506123:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003008 00000100:00100000:2.0:1788873673.506157:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788873673.506165:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859003008:12345-0@lo:502: 00000100:00100000:2.0:1788873673.506301:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859003008:12345-0@lo:502: Request processed in 136us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.506309:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788873673.506454:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003008:0@lo:502: 00000040:00080000:3.0:1788873673.506522:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788873673.506533:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788873673.507632:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788873673.507643:0:8442:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788873673.507651:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873673.507653:0:8442:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788873673.507659:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873673.507674:0:8442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d347a794d40) 00000020:00000080:3.0:1788873673.507697:0:8442:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788873673.507704:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788873673.507784:0:8442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3476df3800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788873673.507791:0:8442:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788873673.507797:0:8442:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c660afb0a9b38a 00010000:00010000:3.0:1788873673.514069:0:8442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788873673.514401:0:8442:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788873673.518266:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788873673.519074:0:8442:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788873673.540785:0:8442:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788873673.543527:0:8442:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788873673.552715:0:8442:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788873673.556195:0:8442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788873673.556243:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873673.556251:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873673.556259:0:8442:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788873673.556263:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873673.556268:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873673.556270:0:8442:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788873673.556273:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788873673.556275:0:8442:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788873673.556309:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873673.556312:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873673.556313:0:8442:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788873673.556316:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788873673.558008:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788873673.558070:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788873673.558095:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558114:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873673.558144:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3476df3800 from 1 10000000:01000000:1.0:1788873673.558147:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873673.558199:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558224:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558235:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.558260:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003136:0@lo:101: 00000100:00100000:1.0:1788873673.558329:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.558374:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873673.558401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003136 00000100:00100000:1.0:1788873673.558409:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003136 00000100:00100000:1.0:1788873673.558458:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788873673.558468:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:8418:x1875769859003136:12345-0@lo:101: 00010000:00010000:1.0:1788873673.558482:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873673.558494:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b391 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558517:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558529:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558556:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeae00, rc 0) 00000100:00100000:1.0:1788873673.558599:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003136:12345-0@lo:101: Request processed in 133us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873673.558605:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788873673.558669:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003136:0@lo:101: 00010000:00010000:1.0:1788873673.558684:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.558693:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.558781:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003264:0@lo:501: 00000100:00100000:1.0:1788873673.558807:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.559766:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003264 00000100:00100000:1.0:1788873673.559775:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003264 00000100:00100000:1.0:1788873673.559830:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788873673.559840:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003264:12345-0@lo:501: 00000100:00100000:1.0:1788873673.560099:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003264:12345-0@lo:501: Request processed in 261us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873673.560108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788873673.560148:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873673.560165:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003264:0@lo:501: 00000100:00100000:1.0:1788873673.560220:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003392:0@lo:503: 00000100:00100000:1.0:1788873673.560262:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.560278:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505aba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873673.560296:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003392 00000100:00100000:1.0:1788873673.560300:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003392 00000100:00100000:1.0:1788873673.560322:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788873673.560328:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003392:12345-0@lo:503: 00000100:00100000:1.0:1788873673.560401:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003392:12345-0@lo:503: Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873673.560407:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788873673.560448:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003392:0@lo:503: 00000040:00080000:1.0:1788873673.561599:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788873673.561693:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003520:0@lo:502: 00000100:00100000:1.0:1788873673.561748:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.561787:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447152180 going to sleep for 11 seconds 00000100:00100000:0.0:1788873673.562258:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003520 00000100:00100000:0.0:1788873673.562267:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003520 00000100:00100000:0.0:1788873673.562317:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788873673.562327:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003520:12345-0@lo:502: 00000100:00100000:0.0:1788873673.562459:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003520:12345-0@lo:502: Request processed in 133us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.562466:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788873673.562562:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003520:0@lo:502: 00000040:00080000:2.0:1788873673.562848:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788873673.562888:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788873673.562928:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003648:0@lo:502: 00000100:00100000:2.0:1788873673.562980:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.563374:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873673.563462:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003648 00000100:00100000:0.0:1788873673.563467:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003648 00000100:00100000:0.0:1788873673.563511:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788873673.563520:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003648:12345-0@lo:502: 00000100:00100000:0.0:1788873673.563620:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003648:12345-0@lo:502: Request processed in 101us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.563627:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788873673.566590:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003648:0@lo:502: 00000040:00080000:2.0:1788873673.566734:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788873673.566749:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788873673.567717:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873673.567728:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873673.567731:0:8446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788873673.567739:0:8446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3476df3800 00000020:00000080:2.0:1788873673.567742:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788873673.567754:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873673.567757:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873673.567758:0:8446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788873673.567761:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788873673.578509:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788873673.578558:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873673.578581:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873673.578595:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873673.579562:0:8418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788873673.579568:0:8418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3476df3800 10000000:01000000:1.0:1788873673.579571:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3476df3800 10000000:01000000:1.0:1788873673.579575:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788873673.579582:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3476df3800 from 1 10000000:01000000:1.0:1788873673.579585:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788873673.579620:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.579631:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.579642:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.581097:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003776:0@lo:101: 00000100:00100000:1.0:1788873673.581171:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.581345:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003776 00000100:00100000:2.0:1788873673.581353:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003776 00000100:00100000:2.0:1788873673.581412:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788873673.581421:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8418:x1875769859003776:12345-0@lo:101: 00010000:00010000:2.0:1788873673.581438:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873673.581453:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b39f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.581480:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.581491:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.581511:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215fa00, rc 0) 00000100:00100000:2.0:1788873673.581549:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859003776:12345-0@lo:101: Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.581557:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788873673.581756:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447152540 going to sleep for 11 seconds 00000100:00100000:1.0:1788873673.581781:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003776:0@lo:101: 00010000:00010000:1.0:1788873673.581796:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.581806:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.582466:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003904:0@lo:501: 00000100:00100000:1.0:1788873673.582508:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.582540:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447152540 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.583076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859003904 00000100:00100000:2.0:1788873673.583084:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859003904 00000100:00100000:2.0:1788873673.583134:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788873673.583143:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859003904:12345-0@lo:501: 00000100:00100000:2.0:1788873673.583314:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859003904:12345-0@lo:501: Request processed in 172us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.583322:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788873673.584182:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859003904:0@lo:501: 00000100:00100000:1.0:1788873673.588258:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859004032:0@lo:503: 00000100:00100000:1.0:1788873673.588364:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.588413:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447152540 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.589252:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004032 00000100:00100000:2.0:1788873673.589261:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004032 00000100:00100000:2.0:1788873673.589315:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788873673.589324:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859004032:12345-0@lo:503: 00000100:00100000:2.0:1788873673.589460:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859004032:12345-0@lo:503: Request processed in 136us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.589467:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788873673.590629:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859004032:0@lo:503: 00000040:00080000:1.0:1788873673.591193:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788873673.591317:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859004160:0@lo:502: 00000100:00100000:1.0:1788873673.591388:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.591424:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f06780 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.591515:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004160 00000100:00100000:2.0:1788873673.591523:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004160 00000100:00100000:2.0:1788873673.591563:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788873673.591572:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859004160:12345-0@lo:502: 00000100:00100000:2.0:1788873673.591693:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859004160:12345-0@lo:502: Request processed in 121us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.591700:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788873673.592018:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859004160:0@lo:502: 00000040:00080000:1.0:1788873673.592458:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788873673.592485:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788873673.592498:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788873673.592512:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788873673.592523:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788873673.592535:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788873673.592556:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788873673.592567:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788873673.592578:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788873673.592590:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788873673.592602:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788873673.592614:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788873673.592642:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788873673.592814:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788873673.592908:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788873673.593007:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788873673.593125:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788873673.593144:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788873673.593156:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788873673.593168:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788873673.593181:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788873673.593194:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788873673.593390:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788873673.593411:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788873673.593425:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788873673.593436:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788873673.593447:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788873673.593459:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788873673.593489:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788873673.593504:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788873673.593515:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788873673.593526:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788873673.593538:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788873673.593550:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788873673.593562:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788873673.593575:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788873673.593587:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788873673.593625:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859004288:0@lo:502: 00000100:00100000:1.0:1788873673.593772:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.594141:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f06780 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.594782:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004288 00000100:00100000:2.0:1788873673.594798:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004288 00000100:00100000:3.0:1788873673.595172:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788873673.595184:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859004288:12345-0@lo:502: 00000100:00100000:3.0:1788873673.595459:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859004288:12345-0@lo:502: Request processed in 277us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.595467:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788873673.595550:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859004288:0@lo:502: 00000040:00080000:1.0:1788873673.595628:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788873673.595640:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788873673.596428:0:8447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788873673.596446:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d3476e2cd40) 00000020:00000080:2.0:1788873673.596470:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788873673.596562:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3476df3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788873673.596566:0:8447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3476df3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788873673.596569:0:8447:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3476df3800 3 00010000:00080000:2.0:1788873673.596614:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3342559000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873673.601407:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788873673.601692:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788873673.601741:0:8447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788873673.601756:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x25c660afb0a9b3b4 00000100:00080000:2.0:1788873673.601769:0:8447:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788873673.601776:0:8447:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3342559000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873673.602193:0:8447:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3475e5ad80 x1875769859004416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873673.602247:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788873673.602450:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859004544:0@lo:400: 00000100:00100000:2.0:1788873673.602524:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.602573:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873673.602579:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859004928:0@lo:400: 00000100:00100000:2.0:1788873673.602604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.602642:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004928 00000100:00100000:2.0:1788873673.602659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004928 00000100:00100000:2.0:1788873673.602700:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788873673.602709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859004928:12345-0@lo:400: 00000100:00100000:2.0:1788873673.602769:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859004928:12345-0@lo:400: Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.602792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788873673.603141:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004544 00000100:00100000:0.0:1788873673.603148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004544 00000100:00100000:0.0:1788873673.603183:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788873673.603197:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859004544:12345-0@lo:400: 00000100:00100000:0.0:1788873673.603258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859004544:12345-0@lo:400: Request processed in 62us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.603265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873673.603342:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859004928:0@lo:400: 00010000:00080000:2.0:1788873673.603356:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3465147b80 x1875769859004544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873673.603367:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859004544:0@lo:400: 00000100:00100000:3.0:1788873673.603453:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859004416:0@lo:38: 00000100:00100000:3.0:1788873673.603491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.603545:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859004672:0@lo:400: 00000100:00100000:3.0:1788873673.603569:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.603594:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873673.603601:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859004800:0@lo:400: 00000100:00100000:3.0:1788873673.603621:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873673.603739:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004672 00000100:00100000:0.0:1788873673.603744:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004672 00000100:00100000:0.0:1788873673.603768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788873673.603775:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859004672:12345-0@lo:400: 00000100:00100000:2.0:1788873673.603844:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004416 00000100:00100000:2.0:1788873673.603848:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004416 00000100:00100000:2.0:1788873673.603860:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859004800 00000100:00100000:2.0:1788873673.603862:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859004800 00000100:00100000:2.0:1788873673.603875:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788873673.603881:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859004800:12345-0@lo:400: 00000100:00100000:1.0:1788873673.605820:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788873673.605834:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788873673.606518:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859004672:12345-0@lo:400: Request processed in 2737us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873673.606530:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788873673.609214:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859004800:12345-0@lo:400: Request processed in 5311us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.609229:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788873673.609276:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873673.609283:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859004416:12345-0@lo:38: 00010000:00080000:2.0:1788873673.609316:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1788873673.609369:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x25c660afb0a9b3bb 00000004:00100000:2.0:1788873673.609388:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788873673.609437:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9d334255f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873673.609531:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875769859004416:12345-0@lo:38: Request processed in 247us (6040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.609538:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788873673.612355:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3465145f80 x1875769859004800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873673.612404:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859004800:0@lo:400: 00000100:00100000:2.0:1788873673.612423:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859004672:0@lo:400: 00010000:00080000:3.0:1788873673.621491:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475e5ad80 x1875769859004416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873673.621508:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873673.621520:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788873673.621530:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788873673.621536:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788873673.621551:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788873673.621559:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859004416:0@lo:38: 00000020:01000004:0.0:1788873673.624086:0:8447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788873673.624104:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d34584ab380) 00000020:00000080:0.0:1788873673.624128:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788873673.624231:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3476df3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788873673.624236:0:8447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3476df3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788873673.624239:0:8447:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3476df3800 3 00010000:00080000:0.0:1788873673.624270:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3341eab800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.120@tcp at head 00010000:00010000:0.0:1788873673.627298:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788873673.627529:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788873673.627575:0:8447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788873673.627588:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x25c660afb0a9b3c9 00000100:00080000:0.0:1788873673.627601:0:8447:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873673.627608:0:8447:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d3341eab800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873673.628348:0:8447:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3465147480 x1875769859005056/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873673.632767:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788873673.635637:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1875769859005056:0@lo:38: 00000100:00100000:1.0:1788873673.635733:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873673.636108:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005056 00000100:00100000:3.0:1788873673.636119:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005056 00000100:00100000:3.0:1788873673.636165:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873673.636173:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859005056:12345-0@lo:38: 00010000:00080000:3.0:1788873673.636229:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1788873673.636289:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x25c660afb0a9b3d0 00000004:00100000:3.0:1788873673.636306:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788873673.636344:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9d3341ece000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873673.636409:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875769859005056:12345-0@lo:38: Request processed in 236us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873673.636416:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788873673.636875:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3465147480 x1875769859005056/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873673.636888:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788873673.636897:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788873673.636905:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788873673.636910:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788873673.637099:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3341eab800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788873673.637106:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1875769859005056:0@lo:38: 00000040:00080000:1.0:1788873673.637310:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788873673.637365:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788873673.637391:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788873673.637407:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.637417:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788873673.637475:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788873673.637478:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788873673.637479:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873673.637480:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873673.637482:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873673.637483:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873673.637484:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788873673.637486:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788873673.637487:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788873673.637489:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873673.637490:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788873673.637493:0:8418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788873673.637496:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788873673.637497:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788873673.637498:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873673.637500:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873673.637501:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873673.637502:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873673.637503:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788873673.637504:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788873673.637505:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788873673.637506:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873673.637507:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788873673.638014:0:8418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788873673.638037:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859005184:0@lo:253: 00000100:00100000:1.0:1788873673.638101:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873673.638142:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451739d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873673.639282:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005184 00000100:00100000:3.0:1788873673.639291:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005184 00000100:00100000:3.0:1788873673.639335:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788873673.639343:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859005184:12345-0@lo:253: 20000000:01000000:3.0:1788873673.639368:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788873673.639382:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788873673.646918:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788873673.646934:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788873673.647411:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:8418:x1875769859005184:12345-0@lo:253: Request processed in 8063us (9304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.647423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 20000000:01000000:1.0:1788873673.647428:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788873673.647433:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788873673.647454:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.647470:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.647489:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.647498:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.647553:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.647568:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 15 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.647582:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859005312:0@lo:104: 00000100:00100000:1.0:1788873673.647624:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.647668:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788873673.647681:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005312 00010000:00010000:1.0:1788873673.647683:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.647688:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005312 00010000:00010000:1.0:1788873673.647690:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 15 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873673.647697:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859005440:0@lo:104: 00000100:00100000:1.0:1788873673.647717:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.647722:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005440 00000100:00100000:2.0:1788873673.647725:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005440 00000100:00100000:1.0:1788873673.647727:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873673.647738:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873673.647746:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476353850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6526:x1875769859005312:12345-0@lo:104: 00010000:00010000:2.0:1788873673.647758:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.647805:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788873673.647811:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476353850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6526:x1875769859005312:12345-0@lo:104: Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.647817:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873673.647867:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788873673.647874:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769859005440:12345-0@lo:104: 00010000:00010000:2.0:1788873673.647881:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.647913:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788873673.647917:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769859005440:12345-0@lo:104: Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.647930:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788873673.647950:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788873673.647956:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.647963:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92c00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873673.647976:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.647985:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873673.647993:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873673.648000:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873673.648031:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648038:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873673.648053:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648060:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9b2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648072:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873673.648074:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648090:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dc400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873673.648093:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648100:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873673.648106:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873673.648112:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873673.648127:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648132:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873673.648145:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648151:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dc400/0x25c660afb0a9b2c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b2cd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.648165:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873673.648167:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873673.648169:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873673.648174:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873673.648191:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859005568:0@lo:103: 00000100:00100000:2.0:1788873673.648238:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.648271:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859005696:0@lo:103: 00000100:00100000:1.0:1788873673.648310:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859005312:0@lo:104: 00000100:00100000:1.0:1788873673.659099:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859005440:0@lo:104: 00010000:00010000:1.0:1788873673.659139:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.659299:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873673.659441:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005568 00000100:00100000:2.0:1788873673.659449:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005568 00010000:00010000:2.0:1788873673.659878:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 16 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.659909:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005696 00000100:00100000:2.0:1788873673.659912:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005696 00010000:00010000:2.0:1788873673.659925:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 17 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873673.659939:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873673.659946:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3636:x1875769859005568:12345-0@lo:103: 00010000:00010000:2.0:1788873673.659960:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873673.659965:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 17 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.659985:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 17 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660002:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d34821dc600/0x25c660afb0a9b2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b2e2 expref: 17 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660019:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873673.660081:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3636:x1875769859005568:12345-0@lo:103: Request processed in 135us (11842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.660088:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873673.660111:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788873673.660117:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3633:x1875769859005696:12345-0@lo:103: 00010000:00010000:2.0:1788873673.660125:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873673.660138:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 15 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660146:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 15 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660156:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b2cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b2c6 expref: 15 pid: 6506 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660168:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660176:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788873673.660397:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012964440s 00010000:00010000:2.0:1788873673.660402:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660408:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660415:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660421:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660427:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfebe00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873673.660432:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.660440:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.661298:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873673.661377:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873673.661433:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3633:x1875769859005696:12345-0@lo:103: Request processed in 1315us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873673.661442:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788873673.661688:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859005568:0@lo:103: 00010000:00010000:1.0:1788873673.661925:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.661935:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873673.661941:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfebe00/0x25c660afb0a9b3d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873673.662076:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8418:1875769859005184:0@lo:253: 10000000:01000000:0.0:1788873673.662093:0:8418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788873673.662096:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788873673.662098:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788873673.662099:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873673.662100:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873673.662101:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873673.662102:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873673.662104:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788873673.662105:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788873673.662106:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788873673.662108:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873673.662110:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788873673.662121:0:8418:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788873673.663035:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859005696:0@lo:103: 00080000:10000000:2.0:1788873673.681263:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788873673.681444:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788873673.681651:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788873673.681816:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788873673.684752:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788873673.686457:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788873673.692798:0:8418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788873673.703836:0:8418:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788873673.703847:0:8418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788873673.703896:0:8418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788873673.703947:0:8418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788873673.704079:0:8418:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788873673.704103:0:8418:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788873673.705139:0:8418:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873673.705433:0:8418:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788873673.840441:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788873674.790918:0:8504:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873674.791180:0:8504:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788873674.862352:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873675.502657:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859005824:0@lo:41: 00000100:00100000:3.0:1788873675.502751:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873675.502892:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005824 00000100:00100000:0.0:1788873675.502902:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005824 00000100:00100000:0.0:1788873675.502968:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788873675.502979:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859005824:12345-0@lo:41: 00000004:00000024:0.0:1788873675.503015:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788873675.503070:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859005824:12345-0@lo:41: Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873675.503077:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873675.503474:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859005824:0@lo:41: 00010000:00010000:2.0:1788873675.887237:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873676.910442:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873677.934767:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873678.070638:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873678.080917:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859005952:0@lo:41: 00000100:00100000:1.0:1788873678.081005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873678.085554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859005952 00000100:00100000:2.0:1788873678.085570:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859005952 00000100:00100000:2.0:1788873678.085648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788873678.085660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859005952:12345-0@lo:41: 00000004:00000024:2.0:1788873678.085701:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788873678.085797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859005952:12345-0@lo:41: Request processed in 140us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873678.085805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788873678.086576:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859005952:0@lo:41: 00010000:00010000:2.0:1788873678.964590:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873679.087940:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859006336:0@lo:400: 00000100:00100000:3.0:1788873679.088042:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873679.088107:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859006848:0@lo:400: 00000100:00100000:3.0:1788873679.088141:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873679.088189:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788873679.088195:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859006208:0@lo:400: 00000100:00100000:3.0:1788873679.088240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873679.088263:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859006720:0@lo:400: 00000100:00100000:3.0:1788873679.088302:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873679.088358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006336 00000100:00100000:3.0:1788873679.088370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006336 00000100:00100000:3.0:1788873679.088438:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788873679.088450:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859006336:12345-0@lo:400: 00000100:00100000:0.0:1788873679.088567:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859006080:0@lo:400: 00000100:00100000:0.0:1788873679.088613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873679.088643:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859006592:0@lo:400: 00000100:00100000:0.0:1788873679.088671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873679.088690:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873679.088694:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859006464:0@lo:400: 00000100:00100000:0.0:1788873679.088718:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873679.088754:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006080 00000100:00100000:0.0:1788873679.088758:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006080 00000100:00100000:0.0:1788873679.088813:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788873679.088820:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3636:x1875769859006080:12345-0@lo:400: 00000100:00100000:0.0:1788873679.088871:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3636:x1875769859006080:12345-0@lo:400: Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873679.088879:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788873679.088934:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006592 00000100:00100000:0.0:1788873679.088939:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006592 00000100:00100000:0.0:1788873679.088961:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788873679.088968:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859006592:12345-0@lo:400: 00000100:00100000:0.0:1788873679.089000:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859006592:12345-0@lo:400: Request processed in 33us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873679.089006:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788873679.089026:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006848 00000100:00100000:0.0:1788873679.089029:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006848 00000100:00100000:0.0:1788873679.089062:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006208 00000100:00100000:0.0:1788873679.089065:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006208 00000100:00100000:0.0:1788873679.089079:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006720 00000100:00100000:0.0:1788873679.089082:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006720 00000100:00100000:0.0:1788873679.089096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006464 00000100:00100000:0.0:1788873679.089098:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006464 00000100:00100000:0.0:1788873679.089112:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788873679.089118:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859006848:12345-0@lo:400: 00000100:00100000:0.0:1788873679.089155:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859006848:12345-0@lo:400: Request processed in 37us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873679.089161:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788873679.089173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788873679.089180:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859006208:12345-0@lo:400: 00000100:00100000:0.0:1788873679.089235:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859006208:12345-0@lo:400: Request processed in 56us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873679.089250:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788873679.089263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788873679.089269:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859006720:12345-0@lo:400: 00000100:00100000:0.0:1788873679.089298:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859006720:12345-0@lo:400: Request processed in 30us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873679.089304:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788873679.089316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788873679.089323:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859006464:12345-0@lo:400: 00000100:00100000:0.0:1788873679.089350:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859006464:12345-0@lo:400: Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873679.089356:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788873679.089380:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873679.089384:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788873679.089415:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475ef8e00 x1875769859006464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873679.089434:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859006464:0@lo:400: 00000100:00100000:0.0:1788873679.089444:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859006080:0@lo:400: 00000100:00100000:0.0:1788873679.089453:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859006592:0@lo:400: 00010000:00080000:0.0:1788873679.089504:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475ef9880 x1875769859006208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873679.089514:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859006208:0@lo:400: 00010000:00080000:0.0:1788873679.089530:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475ef8380 x1875769859006720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873679.089538:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859006720:0@lo:400: 00010000:00080000:0.0:1788873679.089563:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475d90000 x1875769859006848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873679.089571:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859006848:0@lo:400: 00000100:00100000:3.0:1788873679.089731:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859006336:12345-0@lo:400: Request processed in 1283us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873679.089739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788873679.090172:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859006336:0@lo:400: 00010000:00010000:3.0:1788873679.986235:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873680.622359:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873680.622403:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859006976:0@lo:41: 00000100:00100000:1.0:1788873680.622539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873680.622636:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859006976 00000100:00100000:1.0:1788873680.622649:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859006976 00000100:00100000:1.0:1788873680.622717:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788873680.622728:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859006976:12345-0@lo:41: 00000004:00000024:1.0:1788873680.622775:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788873680.622851:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859006976:12345-0@lo:41: Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873680.622859:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788873680.622929:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859006976:0@lo:41: 00010000:00010000:2.0:1788873681.013388:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788873681.648501:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788873681.648512:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34651cb800 from 30 10000000:01000000:2.0:1788873681.648522:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788873681.648593:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.648607:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.648621:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873681.648658:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007104:0@lo:101: 00000100:00100000:2.0:1788873681.648765:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873681.648842:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.648913:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007104 00000100:00100000:0.0:1788873681.648925:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007104 00000100:00100000:0.0:1788873681.649013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788873681.649028:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:6508:x1875769859007104:12345-0@lo:101: 00010000:00010000:0.0:1788873681.649045:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873681.649062:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b3de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.649098:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.649111:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.649121:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93200, rc 0) 00000100:00100000:0.0:1788873681.649183:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859007104:12345-0@lo:101: Request processed in 160us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.649191:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788873681.650333:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007104:0@lo:101: 00010000:00010000:2.0:1788873681.650362:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.650374:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873681.650480:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007232:0@lo:501: 00000100:00100000:2.0:1788873681.650528:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873681.650578:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.650749:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007232 00000100:00100000:0.0:1788873681.650756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007232 00000100:00100000:0.0:1788873681.650817:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788873681.650829:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859007232:12345-0@lo:501: 00000100:00100000:0.0:1788873681.651028:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859007232:12345-0@lo:501: Request processed in 201us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.651047:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788873681.651137:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007232:0@lo:501: 00000100:00100000:1.0:1788873681.651175:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007360:0@lo:503: 00000100:00100000:1.0:1788873681.651252:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873681.651278:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a4c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.651343:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007360 00000100:00100000:2.0:1788873681.651348:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007360 00000100:00100000:2.0:1788873681.651392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788873681.651399:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859007360:12345-0@lo:503: 00000100:00100000:2.0:1788873681.651504:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859007360:12345-0@lo:503: Request processed in 104us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.651511:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788873681.651602:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007360:0@lo:503: 00000100:00100000:0.0:1788873681.652485:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8777:1875769859007488:0@lo:502: 00000100:00100000:0.0:1788873681.652552:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.652590:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.652691:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007488 00000100:00100000:2.0:1788873681.652697:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007488 00000100:00100000:2.0:1788873681.652741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788873681.652751:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8777:x1875769859007488:12345-0@lo:502: 00000100:00100000:2.0:1788873681.652885:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8777:x1875769859007488:12345-0@lo:502: Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.652903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788873681.653118:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8777:1875769859007488:0@lo:502: 00000100:00100000:0.0:1788873681.653171:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8777:1875769859007616:0@lo:502: 00000100:00100000:0.0:1788873681.653230:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.653257:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007616 00000100:00100000:0.0:1788873681.653261:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007616 00000100:00100000:0.0:1788873681.653296:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788873681.653304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8777:x1875769859007616:12345-0@lo:502: 00000100:00100000:0.0:1788873681.653379:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:8777:x1875769859007616:12345-0@lo:502: Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.653386:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788873681.653421:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.653432:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8777:1875769859007616:0@lo:502: 00000040:00080000:0.0:1788873681.653449:0:8777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788873681.655104:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788873681.655151:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788873681.655167:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.655182:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873681.655195:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788873681.655236:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34651cb800 from 5 10000000:01000000:0.0:1788873681.655240:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873681.655298:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.655308:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.655323:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.655357:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007744:0@lo:101: 00000100:00100000:0.0:1788873681.655444:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.655498:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.655632:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007744 00000100:00100000:2.0:1788873681.655642:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007744 00000100:00100000:2.0:1788873681.655703:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788873681.655715:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859007744:12345-0@lo:101: 00010000:00010000:2.0:1788873681.655730:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873681.655747:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b3ec expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.655780:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.655792:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.655803:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f600, rc 0) 00000100:00100000:2.0:1788873681.655852:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859007744:12345-0@lo:101: Request processed in 139us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.655859:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788873681.656142:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007744:0@lo:101: 00010000:00010000:0.0:1788873681.656161:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656172:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.656256:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007872:0@lo:256: 00000100:00100000:0.0:1788873681.656295:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.656315:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.656331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859007872 00000100:00100000:0.0:1788873681.656336:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859007872 00000100:00100000:0.0:1788873681.656374:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873681.656382:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859007872:12345-0@lo:256: 20000000:01000000:0.0:1788873681.656399:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788873681.656424:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788873681.656428:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788873681.656528:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859007872:12345-0@lo:256: Request processed in 146us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.656536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873681.656573:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859007872:0@lo:256: 10000000:01000000:0.0:1788873681.656619:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788873681.656626:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656635:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873681.656644:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788873681.656646:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788873681.656649:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788873681.656670:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656677:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656685:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.656696:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859008000:0@lo:101: 00000100:00100000:0.0:1788873681.656720:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.656733:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.656746:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008000 00000100:00100000:0.0:1788873681.656750:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008000 00000100:00100000:0.0:1788873681.656780:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788873681.656786:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859008000:12345-0@lo:101: 00010000:00010000:0.0:1788873681.656794:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873681.656804:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b3fa expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656819:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656828:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656835:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92000, rc 0) 00000100:00100000:0.0:1788873681.656864:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859008000:12345-0@lo:101: Request processed in 78us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.656869:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788873681.656910:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859008000:0@lo:101: 00010000:00010000:0.0:1788873681.656921:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.656928:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.656990:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859008128:0@lo:501: 00000100:00100000:0.0:1788873681.657017:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.657030:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.657041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008128 00000100:00100000:0.0:1788873681.657044:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008128 00000100:00100000:0.0:1788873681.657066:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788873681.657079:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859008128:12345-0@lo:501: 00000100:00100000:0.0:1788873681.657260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859008128:12345-0@lo:501: Request processed in 182us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.657267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788873681.657295:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859008128:0@lo:501: 00000100:00100000:0.0:1788873681.657325:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859008256:0@lo:503: 00000100:00100000:0.0:1788873681.657369:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.657383:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.657394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008256 00000100:00100000:0.0:1788873681.657398:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008256 00000100:00100000:0.0:1788873681.657427:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788873681.657435:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859008256:12345-0@lo:503: 00000100:00100000:0.0:1788873681.657524:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859008256:12345-0@lo:503: Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.657531:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788873681.657577:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859008256:0@lo:503: 00000100:00100000:0.0:1788873681.657842:0:8778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8778:1875769859008384:0@lo:502: 00000100:00100000:0.0:1788873681.657886:0:8778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.657926:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008384 00000100:00100000:0.0:1788873681.657932:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008384 00000100:00100000:0.0:1788873681.657958:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788873681.657964:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8778:x1875769859008384:12345-0@lo:502: 00000100:00100000:0.0:1788873681.658052:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8778:x1875769859008384:12345-0@lo:502: Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.658058:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788873681.658094:0:8778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505abd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.658106:0:8778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8778:1875769859008384:0@lo:502: 00000020:01000000:0.0:1788873681.658129:0:8778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788873681.658138:0:8778:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788873681.658147:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873681.658150:0:8778:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788873681.658155:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788873681.658159:0:8778:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:0.0:1788873681.658189:0:8778:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788873681.658191:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788873681.658237:0:8778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d34584a99c0) 00000020:00000080:0.0:1788873681.658270:0:8778:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788873681.658276:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788873681.658378:0:8778:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788873681.658388:0:8778:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788873681.658396:0:8778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9b40f 00010000:00080000:0.0:1788873681.658438:0:8778:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d33428ed000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:0.0:1788873681.658727:0:8778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788873681.673186:0:8778:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788873681.673248:0:8778:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788873681.673519:0:8778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873681.673773:0:8778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873681.673875:0:8778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788873681.673991:0:8778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788873681.675880:0:8779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873681.675887:0:8779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788873681.677085:0:8778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788873681.677099:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788873681.677144:0:8778:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788873681.677167:0:8778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b416 00000100:00080000:1.0:1788873681.677184:0:8778:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873681.677190:0:8778:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d33428ed000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873681.677260:0:8778:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3451801880 x1875769859008512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873681.677337:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859008512:0@lo:8: 00000100:00100000:3.0:1788873681.677433:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788873681.677651:0:8778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788873681.677725:0:8778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873681.677730:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873681.677731:0:8778:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788873681.677734:0:8778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873681.677739:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873681.677740:0:8778:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788873681.677743:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788873681.677745:0:8778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788873681.677782:0:8778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8778:1875769859008640:0@lo:502: 00000100:00100000:1.0:1788873681.677830:0:8778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873681.677859:0:8778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f06780 going to sleep for 11 seconds 00000100:00100000:1.0:1788873681.678181:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008512 00000100:00100000:1.0:1788873681.678188:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008512 00000100:00100000:1.0:1788873681.678245:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873681.678252:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3632:x1875769859008512:12345-0@lo:8: 00010000:00080000:1.0:1788873681.678279:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1788873681.678304:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b41d 00002000:00100000:1.0:1788873681.678339:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d334276d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788873681.678343:0:8424:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788873681.678348:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788873681.678575:0:8424:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788873681.679135:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788873681.679163:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9d3342768000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873681.684770:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008640 00000100:00100000:0.0:1788873681.684792:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008640 00000100:00100000:0.0:1788873681.684877:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873681.684901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8778:x1875769859008640:12345-0@lo:502: 00000100:00100000:0.0:1788873681.685170:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:8778:x1875769859008640:12345-0@lo:502: Request processed in 282us (7338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.685178:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873681.686489:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859009152:0@lo:400: 00000100:00100000:0.0:1788873681.686560:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.686608:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788873681.686614:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859008768:0@lo:400: 00000100:00100000:0.0:1788873681.686651:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.686669:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859009280:0@lo:400: 00000100:00100000:0.0:1788873681.686690:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.686717:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859008896:0@lo:400: 00000100:00100000:0.0:1788873681.686741:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.686759:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859009408:0@lo:400: 00000100:00100000:0.0:1788873681.686780:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.686799:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873681.686804:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859009024:0@lo:400: 00000100:00100000:0.0:1788873681.686826:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.686864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009152 00000100:00100000:0.0:1788873681.686874:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009152 00000100:00100000:0.0:1788873681.686933:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008896 00000100:00100000:0.0:1788873681.686937:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008896 00000100:00100000:0.0:1788873681.686956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873681.686965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859009152:12345-0@lo:400: 00000100:00100000:0.0:1788873681.687024:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859009152:12345-0@lo:400: Request processed in 60us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.687031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873681.687050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788873681.687056:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859008896:12345-0@lo:400: 00000100:00100000:0.0:1788873681.687086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859008896:12345-0@lo:400: Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.687092:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788873681.687110:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859008768 00000100:00100000:0.0:1788873681.687114:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859008768 00000100:00100000:0.0:1788873681.687133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009280 00000100:00100000:0.0:1788873681.687144:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009280 00000100:00100000:0.0:1788873681.687180:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009408 00000100:00100000:0.0:1788873681.687183:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009408 00000100:00100000:0.0:1788873681.687198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009024 00000100:00100000:0.0:1788873681.687201:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009024 00000100:00100000:0.0:1788873681.687243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788873681.687249:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859008768:12345-0@lo:400: 00000100:00100000:0.0:1788873681.687283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859008768:12345-0@lo:400: Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.687289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788873681.687301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788873681.687307:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859009280:12345-0@lo:400: 00000100:00100000:0.0:1788873681.687336:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859009280:12345-0@lo:400: Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.687341:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788873681.687353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788873681.687358:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859009408:12345-0@lo:400: 00000100:00100000:0.0:1788873681.687384:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859009408:12345-0@lo:400: Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.687390:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788873681.687401:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788873681.687407:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859009024:12345-0@lo:400: 00000100:00100000:0.0:1788873681.687433:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859009024:12345-0@lo:400: Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.687438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788873681.687509:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465144a80 x1875769859008768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.687539:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859008768:0@lo:400: 00010000:00080000:0.0:1788873681.687554:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465145c00 x1875769859009280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.687561:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859009280:0@lo:400: 00000100:00100000:0.0:1788873681.687572:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859009152:0@lo:400: 00010000:00080000:0.0:1788873681.687605:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465147b80 x1875769859009024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.687612:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859009024:0@lo:400: 00000100:00100000:0.0:1788873681.687621:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859008896:0@lo:400: 00010000:00080000:0.0:1788873681.687629:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465146680 x1875769859009408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.687636:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859009408:0@lo:400: 00000100:00080000:0.0:1788873681.687651:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873681.687656:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873681.692981:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875769859008512:12345-0@lo:8: Request processed in 14715us (15536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873681.693000:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873681.693074:0:8778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8778:1875769859008640:0@lo:502: 00000020:01000000:1.0:1788873681.693127:0:8778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873681.693140:0:8778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873681.693143:0:8778:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788873681.693149:0:8778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788873681.698960:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788873681.699031:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788873681.699049:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.699067:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873681.699082:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788873681.699087:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34473c7800 from 30 10000000:01000000:0.0:1788873681.699109:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788873681.699168:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.699179:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.699194:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.699261:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859009536:0@lo:101: 00000100:00100000:0.0:1788873681.699380:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788873681.699847:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451801880 x1875769859008512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873681.699865:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873681.699879:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788873681.699889:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788873681.699904:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788873681.699908:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ed000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788873681.699937:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788873681.699943:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859008512:0@lo:8: 00000004:00080000:3.0:1788873681.699987:0:8779:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788873681.700066:0:8779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 218645860918ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788873681.700074:0:8779:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788873681.705480:0:8780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859009664:0@lo:700: 00000100:00100000:0.0:1788873681.705748:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.705778:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009536 00000100:00100000:0.0:1788873681.705787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009536 00000100:00100000:0.0:1788873681.705868:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788873681.705880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859009536:12345-0@lo:101: 00010000:00010000:0.0:1788873681.705907:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873681.705935:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b424 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.705974:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.705990:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.706001:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93600, rc 0) 00000100:00100000:0.0:1788873681.706087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859009536:12345-0@lo:101: Request processed in 209us (6710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.706110:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788873681.706181:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859009536:0@lo:101: 00010000:00010000:0.0:1788873681.706222:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.706234:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.706311:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859009792:0@lo:501: 00000100:00100000:0.0:1788873681.706346:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.706363:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.706377:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009792 00000100:00100000:0.0:1788873681.706381:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009792 00000100:00100000:0.0:1788873681.706406:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788873681.706413:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859009792:12345-0@lo:501: 00000100:00100000:0.0:1788873681.706737:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859009792:12345-0@lo:501: Request processed in 323us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.706745:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788873681.706781:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859009792:0@lo:501: 00000100:00100000:0.0:1788873681.706810:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859009920:0@lo:503: 00000100:00100000:0.0:1788873681.706921:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.706937:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.706950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009920 00000100:00100000:0.0:1788873681.706953:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009920 00000100:00100000:0.0:1788873681.706978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788873681.706985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859009920:12345-0@lo:503: 00000100:00100000:0.0:1788873681.707075:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859009920:12345-0@lo:503: Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.707082:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788873681.707124:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859009920:0@lo:503: 00000100:00100000:0.0:1788873681.707374:0:8782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8782:1875769859010048:0@lo:502: 00000100:00100000:0.0:1788873681.707412:0:8782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.707432:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010048 00000100:00100000:0.0:1788873681.707436:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010048 00000100:00100000:0.0:1788873681.707458:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788873681.707465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8782:x1875769859010048:12345-0@lo:502: 00000100:00100000:0.0:1788873681.709115:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8782:x1875769859010048:12345-0@lo:502: Request processed in 1637us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.709131:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788873681.709261:0:8782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.709297:0:8782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8782:1875769859010048:0@lo:502: 00000100:00100000:0.0:1788873681.709400:0:8782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8782:1875769859010176:0@lo:502: 00000100:00100000:0.0:1788873681.709458:0:8782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.710601:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010176 00000100:00100000:3.0:1788873681.710610:0:8780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.710616:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010176 00000100:00100000:3.0:1788873681.710695:0:8780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334275ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.710701:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788873681.710718:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8782:x1875769859010176:12345-0@lo:502: 00000100:00100000:0.0:1788873681.710878:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:8782:x1875769859010176:12345-0@lo:502: Request processed in 165us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.710886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788873681.710948:0:8782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34520ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.710981:0:8782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8782:1875769859010176:0@lo:502: 00000040:00080000:0.0:1788873681.711019:0:8782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788873681.711104:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788873681.711124:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788873681.711137:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.711150:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873681.711162:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788873681.711165:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34473c7800 from 5 10000000:01000000:0.0:1788873681.711169:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873681.711228:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.711238:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.711250:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.711270:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010304:0@lo:101: 00000100:00100000:0.0:1788873681.711308:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.711327:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34520ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.711343:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010304 00000100:00100000:0.0:1788873681.711347:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010304 00000100:00100000:0.0:1788873681.711373:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788873681.711380:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859010304:12345-0@lo:101: 00010000:00010000:0.0:1788873681.711390:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873681.711412:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b432 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.711440:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.711451:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.711461:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93e00, rc 0) 00000004:00080000:3.0:1788873681.712987:0:7441:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788873681.715306:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859009664 00000100:00100000:2.0:1788873681.715329:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859009664 00000100:00100000:2.0:1788873681.715421:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873681.715434:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8780:x1875769859009664:12345-0@lo:700: 00000100:00100000:2.0:1788873681.715525:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1875769859010432:0@lo:700: 00000100:00100000:2.0:1788873681.715612:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873681.715648:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334275bd80 going to sleep for 11 seconds 00000100:00080000:2.0:1788873681.715667:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873681.715684:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010432 00000100:00100000:2.0:1788873681.715687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010432 00000100:00100000:2.0:1788873681.715713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873681.715719:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1875769859010432:12345-0@lo:700: 00000100:00100000:0.0:1788873681.716105:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859010304:12345-0@lo:101: Request processed in 4720us (4792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.716117:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788873681.716251:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010304:0@lo:101: 00010000:00010000:0.0:1788873681.716285:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.716301:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.716388:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010560:0@lo:256: 00000100:00100000:0.0:1788873681.716445:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.716576:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34520ff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.716745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010560 00000100:00100000:2.0:1788873681.716752:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010560 00000100:00100000:2.0:1788873681.716798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788873681.716807:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859010560:12345-0@lo:256: 20000000:01000000:2.0:1788873681.716830:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788873681.716863:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788873681.716867:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788873681.716982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859010560:12345-0@lo:256: Request processed in 176us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.716989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788873681.720190:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010560:0@lo:256: 10000000:01000000:3.0:1788873681.720289:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873681.720303:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873681.720314:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873681.720324:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788873681.720327:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788873681.720331:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788873681.720375:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873681.720400:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873681.720411:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873681.720434:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010688:0@lo:101: 00000100:00100000:3.0:1788873681.720912:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873681.720965:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34520ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.722221:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010688 00000100:00100000:0.0:1788873681.722240:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010688 00000100:00100000:0.0:1788873681.722324:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788873681.722340:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859010688:12345-0@lo:101: 00010000:00010000:0.0:1788873681.722365:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873681.722390:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b440 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.722444:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.722458:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873681.722469:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92c00, rc 0) 00000100:00100000:0.0:1788873681.722584:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859010688:12345-0@lo:101: Request processed in 249us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.722591:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788873681.723118:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010688:0@lo:101: 00010000:00010000:3.0:1788873681.723157:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873681.723189:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873681.723305:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010816:0@lo:501: 00000100:00100000:3.0:1788873681.723379:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.723446:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010816 00000100:00100000:0.0:1788873681.723455:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010816 00000100:00100000:3.0:1788873681.723464:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34520ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.723975:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788873681.723987:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859010816:12345-0@lo:501: 00000100:00100000:0.0:1788873681.724175:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859010816:12345-0@lo:501: Request processed in 191us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.724183:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788873681.724411:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010816:0@lo:501: 00000100:00100000:3.0:1788873681.724469:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010944:0@lo:503: 00000100:00100000:3.0:1788873681.724616:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873681.724660:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34520ff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.725021:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859010944 00000100:00100000:2.0:1788873681.725033:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859010944 00000100:00100000:2.0:1788873681.725098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788873681.725109:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859010944:12345-0@lo:503: 00000100:00100000:2.0:1788873681.725352:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859010944:12345-0@lo:503: Request processed in 243us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.725361:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788873681.725419:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859010944:0@lo:503: 00000100:00100000:2.0:1788873681.728780:0:8783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8783:1875769859011072:0@lo:502: 00000100:00100000:2.0:1788873681.729121:0:8783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873681.729186:0:8783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334275b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873681.729351:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011072 00000100:00100000:1.0:1788873681.729362:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011072 00000100:00100000:1.0:1788873681.729437:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788873681.729450:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:8783:x1875769859011072:12345-0@lo:502: 00000100:00100000:1.0:1788873681.730302:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:8783:x1875769859011072:12345-0@lo:502: Request processed in 853us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873681.730314:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788873681.730589:0:8783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8783:1875769859011072:0@lo:502: 00000020:01000000:2.0:1788873681.730631:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788873681.730641:0:8783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788873681.730650:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873681.730653:0:8783:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788873681.730658:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788873681.730662:0:8783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:2.0:1788873681.731281:0:8783:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788873681.731286:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873681.731314:0:8783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d3342960000) 00000020:00000080:2.0:1788873681.731342:0:8783:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788873681.731349:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788873681.731806:0:8783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788873681.731813:0:8783:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788873681.731823:0:8783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b455 00010000:00080000:2.0:1788873681.731855:0:8783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3480fa7000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873681.732466:0:8783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:0.0:1788873681.738021:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788873681.752901:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1875769859010432:12345-0@lo:700: Request processed in 37163us (37269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.752927:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788873681.753004:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427d3b80 x1875769859010432/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.753023:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1875769859010432:0@lo:700: 40000000:02000000:0.0:1788873681.753059:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1788873681.755658:0:8783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788873681.756052:0:8783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788873681.756376:0:8783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873681.759329:0:8783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873681.759470:0:8783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788873681.759566:0:8783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788873681.766829:0:8787:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788873681.766838:0:8787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:3.0:1788873681.772943:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788873681.773293:0:8783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788873681.773309:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788873681.773364:0:8783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788873681.773529:0:8783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b45c 00000100:00080000:1.0:1788873681.773542:0:8783:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873681.773549:0:8783:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3480fa7000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873681.773590:0:8783:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3451802a00 x1875769859011200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873681.773678:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859011200:0@lo:8: 00000100:00100000:3.0:1788873681.773749:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788873681.773904:0:8783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788873681.773971:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873681.773976:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873681.773977:0:8783:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788873681.773980:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873681.773984:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873681.773986:0:8783:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788873681.773990:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788873681.773991:0:8783:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788873681.774019:0:8783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8783:1875769859011328:0@lo:502: 00000100:00100000:1.0:1788873681.774068:0:8783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873681.774092:0:8783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480f06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.774283:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011328 00000100:00100000:2.0:1788873681.774291:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011328 00000100:00100000:2.0:1788873681.774375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788873681.774385:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:8783:x1875769859011328:12345-0@lo:502: 00000100:00100000:0.0:1788873681.774527:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8780:x1875769859009664:12345-0@lo:700: Request processed in 59094us (63927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.774539:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:8783:x1875769859011328:12345-0@lo:502: Request processed in 154us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.774554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788873681.774625:0:8783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:8783:1875769859011328:0@lo:502: 00000020:01000000:2.0:1788873681.774654:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788873681.774658:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1788873681.774661:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788873681.774701:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011200 00000100:00100000:0.0:1788873681.774706:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011200 00000100:00100000:0.0:1788873681.774728:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873681.774733:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3632:x1875769859011200:12345-0@lo:8: 00010000:00080000:0.0:1788873681.774754:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1788873681.774778:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b463 00002000:00100000:0.0:1788873681.774790:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d33428ec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788873681.774794:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788873681.774797:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:2.0:1788873681.774843:0:8783:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788873681.774852:0:8783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:0.0:1788873681.774880:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788873681.774917:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d33428ee000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788873681.775037:0:8780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427d1c00 x1875769859009664/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873681.775050:0:8780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859009664:0@lo:700: 00000020:01000000:2.0:1788873681.775179:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788873681.775243:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788873681.775256:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.775267:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873681.775278:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788873681.775281:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3480da19c0 from 1 10000000:01000000:2.0:1788873681.775284:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788873681.775314:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.775605:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.775617:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873681.775636:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859011456:0@lo:101: 00000100:00100000:2.0:1788873681.775840:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873681.775884:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334275bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873681.777702:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011456 00000100:00100000:1.0:1788873681.777716:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011456 00000100:00100000:1.0:1788873681.777790:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788873681.777800:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859011456:12345-0@lo:101: 00010000:00010000:1.0:1788873681.777818:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873681.777837:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b46a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873681.777863:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873681.777876:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873681.777912:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeb000, rc 0) 00000100:00100000:1.0:1788873681.777983:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859011456:12345-0@lo:101: Request processed in 185us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873681.777990:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788873681.778285:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859011456:0@lo:101: 00010000:00010000:2.0:1788873681.778308:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.778319:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873681.780574:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859011584:0@lo:501: 00000100:00100000:2.0:1788873681.780651:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873681.781271:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334275bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.781297:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011584 00000100:00100000:2.0:1788873681.781304:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011584 00000100:00100000:2.0:1788873681.781359:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788873681.781368:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859011584:12345-0@lo:501: 00000100:00100000:2.0:1788873681.783850:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859011584:12345-0@lo:501: Request processed in 1310us (2025us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873681.783864:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788873681.783968:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859011584:0@lo:501: 10000000:01000000:2.0:1788873681.784023:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788873681.784034:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873681.784046:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873681.784520:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3632:x1875769859011200:12345-0@lo:8: Request processed in 9781us (10767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.784530:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:0.0:1788873681.789714:0:8780:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788873681.789750:0:8780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859011840:0@lo:7: 00000100:00100000:0.0:1788873681.789820:0:8780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.789862:0:8780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475fd4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.789882:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859011712:0@lo:13: 00000100:00100000:0.0:1788873681.789919:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.789978:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011840 00000100:00100000:0.0:1788873681.789985:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011840 00000100:00100000:0.0:1788873681.790024:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873681.790032:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8780:x1875769859011840:12345-0@lo:7: 00000100:00100000:2.0:1788873681.790257:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011712 00000100:00100000:2.0:1788873681.790263:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011712 00000100:00100000:2.0:1788873681.790296:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873681.790314:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1875769859011712:12345-0@lo:13: 00002000:00000024:2.0:1788873681.790336:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1788873681.790390:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1875769859011712:12345-0@lo:13: Request processed in 80us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.790537:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788873681.790594:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475ef8e00 x1875769859011712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873681.790613:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859011712:0@lo:13: 00010000:00080000:1.0:1788873681.797485:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451802a00 x1875769859011200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873681.797502:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788873681.797514:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788873681.797523:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788873681.797530:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788873681.797533:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3480fa7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788873681.797554:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788873681.797560:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859011200:0@lo:8: 00000004:00080000:1.0:1788873681.801038:0:8788:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788873681.801045:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859011968:0@lo:13: 00000100:00100000:1.0:1788873681.801065:0:8788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012096:0@lo:7: 00000100:00100000:1.0:1788873681.801329:0:8788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873681.801361:0:8788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.801429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.801549:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788873681.801557:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1788873681.802056:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788873681.802061:0:8424:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788873681.802149:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8780:x1875769859011840:12345-0@lo:7: Request processed in 12099us (12310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.802159:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788873681.802220:0:8780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465146680 x1875769859011840/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.802235:0:8780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859011840:0@lo:7: 00000004:00080000:0.0:1788873681.802247:0:8780:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788873681.802276:0:8780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859012224:0@lo:5: 00000100:00100000:0.0:1788873681.802302:0:8780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.802319:0:8780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475fd4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.802404:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012096 00000100:00100000:0.0:1788873681.802411:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012096 00000100:00100000:0.0:1788873681.802466:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012224 00000100:00100000:0.0:1788873681.802470:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012224 00000100:00100000:0.0:1788873681.802488:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873681.802498:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8788:x1875769859012096:12345-0@lo:7: 00000100:00100000:2.0:1788873681.806028:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859011968 00000100:00100000:2.0:1788873681.806043:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859011968 00000100:00100000:2.0:1788873681.806109:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873681.806118:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875769859011968:12345-0@lo:13: 00002000:00000024:2.0:1788873681.806143:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1788873681.806253:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875769859011968:12345-0@lo:13: Request processed in 135us (4824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.806260:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788873681.806291:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873681.808141:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451802a00 x1875769859011968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873681.808171:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859011968:0@lo:13: 00000004:00080000:1.0:1788873681.808244:0:8787:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788873681.808320:0:8787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 218754113955ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788873681.808326:0:8787:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788873681.809926:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873681.809948:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8780:x1875769859012224:12345-0@lo:5: 00002000:00080000:3.0:1788873681.809983:0:8789:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788873681.810075:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8780:x1875769859012224:12345-0@lo:5: Request processed in 135us (7771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873681.810082:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788873681.811371:0:8780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465146680 x1875769859012224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873681.811401:0:8780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859012224:0@lo:5: 00000004:00080000:1.0:1788873681.811416:0:8780:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788873681.811477:0:8780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859012352:0@lo:5: 00000100:00100000:1.0:1788873681.811527:0:8780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.811563:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012352 00000100:00100000:1.0:1788873681.811569:0:8780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873681.811570:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012352 00000100:00100000:0.0:1788873681.811636:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788873681.811647:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8780:x1875769859012352:12345-0@lo:5: 00002000:00080000:0.0:1788873681.811681:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:1.0:1788873681.812648:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788873681.812655:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788873681.812727:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8788:x1875769859012096:12345-0@lo:7: Request processed in 10230us (11397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873681.812735:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788873681.812788:0:8788:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451801f80 x1875769859012096/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873681.812802:0:8788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012096:0@lo:7: 00000004:00080000:3.0:1788873681.812816:0:8788:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788873681.812848:0:8788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012480:0@lo:5: 00000100:00100000:3.0:1788873681.812903:0:8788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873681.812933:0:8788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475c7c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873681.813081:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012480 00000100:00100000:1.0:1788873681.813088:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012480 00000100:00100000:1.0:1788873681.813126:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873681.813134:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8788:x1875769859012480:12345-0@lo:5: 00002000:00080000:1.0:1788873681.813155:0:8789:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788873681.813159:0:8789:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:1.0:1788873681.816429:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788873681.818855:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8780:x1875769859012352:12345-0@lo:5: Request processed in 7206us (7321us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788873681.818868:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788873681.818937:0:8780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451802a00 x1875769859012352/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873681.818956:0:8780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8780:1875769859012352:0@lo:5: 00000004:00080000:0.0:1788873681.818972:0:8780:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788873681.819012:0:8780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8780:1875769859012608:0@lo:900: 00000100:00100000:0.0:1788873681.819048:0:8780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873681.819080:0:8780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475fd49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873681.819725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012608 00000100:00100000:3.0:1788873681.819734:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012608 00000100:00100000:0.0:1788873681.825444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873681.825599:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8780:x1875769859012608:12345-0@lo:900: 00000100:00100000:0.0:1788873681.825750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8780:x1875769859012608:12345-0@lo:900: Request processed in 293us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873681.825759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788873681.825825:0:8780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465144a80 x1875769859012608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873681.825842:0:8780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8780:1875769859012608:0@lo:900: 00000001:00080000:0.0:1788873681.835626:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1788873681.835643:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788873681.835655:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788873681.835827:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8788:x1875769859012480:12345-0@lo:5: Request processed in 22688us (22919us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788873681.835841:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788873681.835942:0:8788:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427ead80 x1875769859012480/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873681.835954:0:8788:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788873681.835962:0:8788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012480:0@lo:5: 00000004:00080000:3.0:1788873681.835978:0:8788:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788873681.836028:0:8788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012736:0@lo:700: 00000100:00100000:3.0:1788873681.836066:0:8788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873681.836111:0:8788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475c7c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873681.836172:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012736 00000100:00100000:1.0:1788873681.836179:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012736 00000100:00100000:1.0:1788873681.836246:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788873681.836262:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8788:x1875769859012736:12345-0@lo:700: 00000100:00100000:2.0:1788873681.851641:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8788:x1875769859012736:12345-0@lo:700: Request processed in 15369us (15564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873681.851656:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788873681.852045:0:8788:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427ead80 x1875769859012736/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873681.852061:0:8788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012736:0@lo:700: 00000004:02000040:1.0:1788873681.874333:0:8788:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788873681.883322:0:8788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451803480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012864:0@lo:5: 00000100:00100000:1.0:1788873681.883394:0:8788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873681.883454:0:8788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873681.883484:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012864 00000100:00100000:2.0:1788873681.883492:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012864 00000100:00100000:2.0:1788873681.883566:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788873681.883578:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8788:x1875769859012864:12345-0@lo:5: 00002000:00080000:2.0:1788873681.889085:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788873681.889111:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788873681.903296:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8788:x1875769859012864:12345-0@lo:5: Request processed in 19714us (19895us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788873681.903316:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788873681.903734:0:8788:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451803480 x1875769859012864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873681.903753:0:8788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451803480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8788:1875769859012864:0@lo:5: 00000004:00080000:3.0:1788873681.903771:0:8788:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:02000400:0.0:1788873681.935288:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788873682.030706:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788873683.051178:0:8855:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873683.051818:0:8855:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873683.054901:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873683.185148:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859012992:0@lo:41: 00000100:00100000:2.0:1788873683.185260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873683.185932:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859012992 00000100:00100000:1.0:1788873683.185945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859012992 00000100:00100000:1.0:1788873683.186003:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788873683.186014:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859012992:12345-0@lo:41: 00000004:00000024:1.0:1788873683.186052:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788873683.186110:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859012992:12345-0@lo:41: Request processed in 98us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873683.186117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788873683.186744:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859012992:0@lo:41: 00000001:00080000:3.0:1788873683.882793:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788873684.078642:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873685.115036:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873685.744789:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859013120:0@lo:41: 00000100:00100000:2.0:1788873685.744909:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873685.745817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013120 00000100:00100000:1.0:1788873685.745832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013120 00000100:00100000:1.0:1788873685.745935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788873685.745950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859013120:12345-0@lo:41: 00000004:00000024:1.0:1788873685.746003:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788873685.746096:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859013120:12345-0@lo:41: Request processed in 150us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873685.746104:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788873685.749375:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859013120:0@lo:41: 00000020:00000004:2.0:1788873686.088820:0:8956:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873686.089514:0:8956:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873686.129448:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873687.150577:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873687.299127:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873687.299167:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859013248:0@lo:13: 00000100:00100000:0.0:1788873687.299312:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873687.299403:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013248 00000100:00100000:0.0:1788873687.299413:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013248 00000100:00100000:0.0:1788873687.299481:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873687.299492:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859013248:12345-0@lo:13: 00002000:00000024:0.0:1788873687.299528:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873687.299577:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859013248:12345-0@lo:13: Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873687.299584:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788873687.299610:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788873687.299647:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3465144a80 x1875769859013248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873687.299661:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788873687.299686:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859013248:0@lo:13: 00000100:00100000:1.0:1788873687.303091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859013376:0@lo:400: 00000100:00100000:1.0:1788873687.303200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873687.303279:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859013888:0@lo:400: 00000100:00100000:1.0:1788873687.303312:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873687.303344:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788873687.303351:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859013504:0@lo:400: 00000100:00100000:1.0:1788873687.303383:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873687.303402:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859014016:0@lo:400: 00000100:00100000:1.0:1788873687.303425:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873687.303463:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013376 00000100:00100000:1.0:1788873687.303473:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013376 00000100:00100000:1.0:1788873687.303534:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788873687.303544:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859013376:12345-0@lo:400: 00000100:00100000:1.0:1788873687.303605:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859013376:12345-0@lo:400: Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873687.303613:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788873687.303652:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013888 00000100:00100000:1.0:1788873687.303656:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013888 00000100:00100000:1.0:1788873687.303682:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788873687.303689:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859013888:12345-0@lo:400: 00000100:00100000:1.0:1788873687.303725:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859013888:12345-0@lo:400: Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873687.303732:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788873687.303751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013504 00000100:00100000:1.0:1788873687.303755:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013504 00000100:00100000:1.0:1788873687.303781:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014016 00000100:00100000:1.0:1788873687.303785:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014016 00000100:00100000:1.0:1788873687.303818:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788873687.303834:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859013504:12345-0@lo:400: 00000100:00100000:2.0:1788873687.304197:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859013760:0@lo:400: 00000100:00100000:2.0:1788873687.304262:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873687.304280:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859014272:0@lo:400: 00000100:00100000:2.0:1788873687.304310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873687.304340:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788873687.304347:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859013632:0@lo:400: 00000100:00100000:2.0:1788873687.304372:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873687.304389:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859014144:0@lo:400: 00000100:00100000:2.0:1788873687.304431:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873687.304734:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014272 00000100:00100000:0.0:1788873687.304742:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014272 00000100:00100000:0.0:1788873687.304799:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873687.304807:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859014272:12345-0@lo:400: 00000100:00100000:2.0:1788873687.304895:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013760 00000100:00100000:2.0:1788873687.304900:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013760 00000100:00100000:2.0:1788873687.304922:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014144 00000100:00100000:2.0:1788873687.304925:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014144 00000100:00100000:2.0:1788873687.304944:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788873687.304951:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859014016:12345-0@lo:400: 00000100:00100000:2.0:1788873687.305000:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859014016:12345-0@lo:400: Request processed in 48us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873687.305007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788873687.305028:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788873687.305034:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859013760:12345-0@lo:400: 00000100:00100000:0.0:1788873687.314335:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859014272:12345-0@lo:400: Request processed in 9512us (10006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873687.314354:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873687.314435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859013632 00000100:00100000:0.0:1788873687.314449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859013632 00000100:00100000:0.0:1788873687.314538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873687.314549:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859013632:12345-0@lo:400: 00000100:00100000:1.0:1788873687.314735:0:6509:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788873687.314747:0:6509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788873687.314767:0:8450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788873687.314778:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788873687.314789:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859014144:12345-0@lo:400: 00000100:00100000:3.0:1788873687.314982:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859014400:0@lo:13: 00000100:00100000:3.0:1788873687.315045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788873687.315112:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a5500 x1875769859014016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873687.315157:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859014016:0@lo:400: 00000100:00100000:3.0:1788873687.315175:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859013376:0@lo:400: 00000100:00100000:3.0:1788873687.315190:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859013888:0@lo:400: 00000100:00100000:2.0:1788873687.323163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859013760:12345-0@lo:400: Request processed in 18111us (18882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873687.323183:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788873687.323668:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873687.323678:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788873687.323683:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873687.323746:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014400 00000100:00100000:2.0:1788873687.323762:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014400 00000100:00100000:2.0:1788873687.323823:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873687.323833:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859014400:12345-0@lo:13: 00002000:00000024:2.0:1788873687.323884:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873687.323989:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859014400:12345-0@lo:13: Request processed in 157us (8943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873687.323996:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873687.324276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859013632:12345-0@lo:400: Request processed in 9725us (19898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873687.324289:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788873687.324524:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859014144:12345-0@lo:400: Request processed in 9734us (20089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873687.324536:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788873687.324645:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859013504:12345-0@lo:400: Request processed in 20812us (21260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873687.324654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788873687.329603:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a2680 x1875769859014400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873687.329624:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788873687.329663:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859014400:0@lo:13: 00010000:00080000:0.0:1788873687.329685:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451802a00 x1875769859013504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873687.329696:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859013504:0@lo:400: 00000100:00100000:2.0:1788873687.334256:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859013632:0@lo:400: 00010000:00080000:2.0:1788873687.334287:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a4e00 x1875769859014144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873687.334300:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859014144:0@lo:400: 00010000:00080000:2.0:1788873687.334314:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3451801f80 x1875769859013760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873687.334323:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859013760:0@lo:400: 00010000:00080000:2.0:1788873687.334354:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a5f80 x1875769859014272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873687.334363:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859014272:0@lo:400: 00000020:00000004:0.0:1788873687.456907:0:9005:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873687.456924:0:9005:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788873688.178750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873688.302650:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859014528:0@lo:41: 00000100:00100000:1.0:1788873688.302744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873688.302860:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014528 00000100:00100000:1.0:1788873688.302868:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014528 00000100:00100000:1.0:1788873688.302920:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788873688.302930:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859014528:12345-0@lo:41: 00000004:00000024:1.0:1788873688.302979:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788873688.303026:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859014528:12345-0@lo:41: Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873688.303033:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788873688.303083:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859014528:0@lo:41: 00010000:00010000:2.0:1788873689.200449:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873690.222560:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873690.862755:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873690.862779:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859014656:0@lo:41: 00000100:00100000:2.0:1788873690.862860:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873690.862979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014656 00000100:00100000:0.0:1788873690.862987:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014656 00000100:00100000:0.0:1788873690.863030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873690.863037:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859014656:12345-0@lo:41: 00000004:00000024:0.0:1788873690.863066:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788873690.863109:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859014656:12345-0@lo:41: Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873690.863114:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788873690.863223:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859014656:0@lo:41: 00010000:00010000:2.0:1788873691.246359:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873692.270332:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873692.398513:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859014912:0@lo:400: 00000100:00100000:0.0:1788873692.398584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873692.398631:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859015424:0@lo:400: 00000100:00100000:0.0:1788873692.398653:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873692.398681:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788873692.398687:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859015040:0@lo:400: 00000100:00100000:0.0:1788873692.398728:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873692.398743:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859015552:0@lo:400: 00000100:00100000:0.0:1788873692.398763:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873692.399315:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859015936:0@lo:13: 00000100:00100000:0.0:1788873692.399345:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873692.399368:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873692.399373:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859016064:0@lo:13: 00000100:00100000:0.0:1788873692.399393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873692.399420:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015936 00000100:00100000:0.0:1788873692.399427:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015936 00000100:00100000:0.0:1788873692.399464:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016064 00000100:00100000:0.0:1788873692.400138:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016064 00000100:00100000:0.0:1788873692.400172:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873692.400181:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859015936:12345-0@lo:13: 00002000:00000024:0.0:1788873692.400234:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873692.400357:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859015936:12345-0@lo:13: Request processed in 177us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873692.400365:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873692.400386:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788873692.400393:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859016064:12345-0@lo:13: 00002000:00000024:0.0:1788873692.400403:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873692.400426:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859016064:12345-0@lo:13: Request processed in 35us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873692.400431:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788873692.400533:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a1c00 x1875769859016064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873692.400554:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859016064:0@lo:13: 00010000:00080000:0.0:1788873692.400568:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a2a00 x1875769859015936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873692.400579:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859015936:0@lo:13: 00000100:00100000:1.0:1788873692.400684:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859015168:0@lo:400: 00000100:00100000:1.0:1788873692.400725:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873692.400757:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859015680:0@lo:400: 00000100:00100000:1.0:1788873692.400779:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873692.400813:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788873692.400820:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859014784:0@lo:400: 00000100:00100000:1.0:1788873692.400848:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873692.400872:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859015296:0@lo:400: 00000100:00100000:1.0:1788873692.400895:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873692.400915:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859015808:0@lo:400: 00000100:00100000:1.0:1788873692.400933:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873692.400961:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014912 00000100:00100000:1.0:1788873692.400965:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014912 00000100:00100000:1.0:1788873692.400993:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015424 00000100:00100000:1.0:1788873692.401071:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015424 00000100:00100000:1.0:1788873692.401091:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015552 00000100:00100000:1.0:1788873692.401094:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015552 00000100:00100000:1.0:1788873692.401106:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015168 00000100:00100000:1.0:1788873692.401109:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015168 00000100:00100000:1.0:1788873692.401121:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788873692.401129:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859014912:12345-0@lo:400: 00000100:00100000:1.0:1788873692.401170:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859014912:12345-0@lo:400: Request processed in 42us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873692.401176:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788873692.401190:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873692.401196:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859015424:12345-0@lo:400: 00000100:00100000:1.0:1788873692.401249:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859015424:12345-0@lo:400: Request processed in 53us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873692.401265:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873692.401277:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873692.401581:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859015552:12345-0@lo:400: 00000100:00100000:1.0:1788873692.401615:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859015552:12345-0@lo:400: Request processed in 333us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873692.401621:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873692.401634:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788873692.401639:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859015168:12345-0@lo:400: 00000100:00100000:1.0:1788873692.401672:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859015168:12345-0@lo:400: Request processed in 32us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873692.401677:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788873692.401697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015040 00000100:00100000:1.0:1788873692.401701:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015040 00000100:00100000:1.0:1788873692.401724:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015296 00000100:00100000:1.0:1788873692.401727:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015296 00000100:00100000:1.0:1788873692.401738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788873692.401743:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859015040:12345-0@lo:400: 00000100:00100000:1.0:1788873692.401774:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859015040:12345-0@lo:400: Request processed in 30us (3046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873692.401779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788873692.401800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788873692.401807:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859015296:12345-0@lo:400: 00000100:00100000:1.0:1788873692.401834:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859015296:12345-0@lo:400: Request processed in 29us (939us total) trans 0 rc 0/0 00000100:00080000:2.0:1788873692.402022:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873692.402027:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788873692.402030:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873692.402042:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859014784 00000100:00100000:2.0:1788873692.402045:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859014784 00000100:00100000:2.0:1788873692.402075:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788873692.402081:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3633:x1875769859014784:12345-0@lo:400: 00000100:00100000:2.0:1788873692.402114:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3633:x1875769859014784:12345-0@lo:400: Request processed in 33us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873692.402119:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788873692.402153:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015680 00000100:00100000:2.0:1788873692.402157:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015680 00000100:00100000:2.0:1788873692.402176:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859015808 00000100:00100000:2.0:1788873692.402179:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859015808 00000100:00100000:2.0:1788873692.402194:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873692.402199:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859015680:12345-0@lo:400: 00000100:00100000:2.0:1788873692.402243:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859015680:12345-0@lo:400: Request processed in 44us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873692.402262:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873692.402275:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873692.402280:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859015808:12345-0@lo:400: 00000100:00100000:2.0:1788873692.402418:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859015808:12345-0@lo:400: Request processed in 138us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873692.402423:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873692.402627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788873692.402684:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859015040:0@lo:400: 00010000:00080000:1.0:1788873692.402707:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a3100 x1875769859015552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873692.402718:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859015552:0@lo:400: 00010000:00080000:1.0:1788873692.402730:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0380 x1875769859014912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873692.402737:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859014912:0@lo:400: 00010000:00080000:1.0:1788873692.402748:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a3480 x1875769859015424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873692.402755:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859015424:0@lo:400: 00000100:00100000:1.0:1788873692.404444:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859014784:0@lo:400: 00000100:00100000:1.0:1788873692.404637:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859015296:0@lo:400: 00010000:00080000:1.0:1788873692.404653:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0700 x1875769859015808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873692.404663:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859015808:0@lo:400: 00010000:00080000:1.0:1788873692.404674:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0e00 x1875769859015168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873692.404683:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859015168:0@lo:400: 00010000:00080000:1.0:1788873692.404696:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a1880 x1875769859015680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873692.404704:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859015680:0@lo:400: 00010000:00010000:3.0:1788873693.296706:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873693.427454:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873693.427482:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859016192:0@lo:41: 00000100:00100000:3.0:1788873693.427565:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873693.427634:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016192 00000100:00100000:3.0:1788873693.427642:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016192 00000100:00100000:3.0:1788873693.427701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788873693.427711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859016192:12345-0@lo:41: 00000004:00000024:3.0:1788873693.427748:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788873693.427803:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859016192:12345-0@lo:41: Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873693.427810:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788873693.427860:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859016192:0@lo:41: 00010000:00010000:2.0:1788873694.318857:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873695.348346:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873695.989468:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873695.989495:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859016320:0@lo:41: 00000100:00100000:1.0:1788873695.989588:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873695.989665:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016320 00000100:00100000:1.0:1788873695.989673:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016320 00000100:00100000:1.0:1788873695.989728:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788873695.989737:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859016320:12345-0@lo:41: 00000004:00000024:1.0:1788873695.989795:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788873695.989848:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859016320:12345-0@lo:41: Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873695.989855:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788873695.989902:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859016320:0@lo:41: 00010000:00010000:2.0:1788873696.366863:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873697.394362:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873697.520929:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859016448:0@lo:13: 00000100:00100000:0.0:1788873697.521004:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.521050:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859016960:0@lo:400: 00000100:00100000:0.0:1788873697.521073:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.521091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859017472:0@lo:400: 00000100:00100000:0.0:1788873697.521127:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.521156:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788873697.521162:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859016576:0@lo:400: 00000100:00100000:0.0:1788873697.521190:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.521387:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859017088:0@lo:400: 00000100:00100000:0.0:1788873697.521415:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522350:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859017600:0@lo:400: 00000100:00100000:0.0:1788873697.522385:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522495:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859016704:0@lo:400: 00000100:00100000:0.0:1788873697.522525:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522545:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859017216:0@lo:400: 00000100:00100000:0.0:1788873697.522566:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522582:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859017728:0@lo:13: 00000100:00100000:0.0:1788873697.522602:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522623:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788873697.522630:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859016832:0@lo:400: 00000100:00100000:0.0:1788873697.522652:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522668:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859017344:0@lo:400: 00000100:00100000:0.0:1788873697.522686:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873697.522726:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016448 00000100:00100000:0.0:1788873697.522734:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016448 00000100:00100000:0.0:1788873697.522796:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017728 00000100:00100000:0.0:1788873697.522800:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017728 00000100:00100000:0.0:1788873697.522817:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873697.522825:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859016448:12345-0@lo:13: 00002000:00000024:0.0:1788873697.522855:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873697.522903:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859016448:12345-0@lo:13: Request processed in 79us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.522909:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873697.522928:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788873697.522934:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859017728:12345-0@lo:13: 00002000:00000024:0.0:1788873697.522943:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873697.522971:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859017728:12345-0@lo:13: Request processed in 38us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.522977:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788873697.522994:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016960 00000100:00100000:0.0:1788873697.522998:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016960 00000100:00100000:0.0:1788873697.523022:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016704 00000100:00100000:0.0:1788873697.523025:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016704 00000100:00100000:0.0:1788873697.523036:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017216 00000100:00100000:0.0:1788873697.523039:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017216 00000100:00100000:0.0:1788873697.523051:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017344 00000100:00100000:0.0:1788873697.523053:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017344 00000100:00100000:0.0:1788873697.523066:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788873697.523072:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859016960:12345-0@lo:400: 00000100:00100000:0.0:1788873697.523104:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859016960:12345-0@lo:400: Request processed in 32us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.523110:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788873697.523130:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873697.523136:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859016704:12345-0@lo:400: 00000100:00100000:0.0:1788873697.523165:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859016704:12345-0@lo:400: Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.523171:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873697.523182:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788873697.523188:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859017216:12345-0@lo:400: 00000100:00100000:0.0:1788873697.527367:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859017216:12345-0@lo:400: Request processed in 4168us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.527382:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788873697.527483:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788873697.527500:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859017344:12345-0@lo:400: 00000100:00100000:0.0:1788873697.527591:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859017344:12345-0@lo:400: Request processed in 98us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.527597:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788873697.527624:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017472 00000100:00100000:0.0:1788873697.527633:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017472 00000100:00100000:0.0:1788873697.527668:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017600 00000100:00100000:0.0:1788873697.527671:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017600 00000100:00100000:0.0:1788873697.527696:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873697.527703:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859017472:12345-0@lo:400: 00000100:00100000:0.0:1788873697.527735:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859017472:12345-0@lo:400: Request processed in 33us (6608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.527753:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873697.527766:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873697.527773:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859017600:12345-0@lo:400: 00000100:00100000:0.0:1788873697.527801:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859017600:12345-0@lo:400: Request processed in 30us (5416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.527816:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873697.527839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016576 00000100:00100000:0.0:1788873697.527843:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016576 00000100:00100000:0.0:1788873697.527871:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788873697.527877:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859016576:12345-0@lo:400: 00000100:00100000:0.0:1788873697.527908:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859016576:12345-0@lo:400: Request processed in 32us (6717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.527914:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788873697.527943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017088 00000100:00100000:0.0:1788873697.527947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017088 00000100:00100000:0.0:1788873697.527972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859016832 00000100:00100000:0.0:1788873697.527976:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859016832 00000100:00100000:0.0:1788873697.527988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788873697.527993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859017088:12345-0@lo:400: 00000100:00100000:0.0:1788873697.528026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859017088:12345-0@lo:400: Request processed in 32us (6610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.528032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788873697.528043:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788873697.528049:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859016832:12345-0@lo:400: 00000100:00100000:0.0:1788873697.528074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859016832:12345-0@lo:400: Request processed in 26us (5422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873697.528080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788873697.528117:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873697.528122:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873697.528125:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873697.528155:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859016576:0@lo:400: 00000100:00100000:0.0:1788873697.528169:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859017088:0@lo:400: 00010000:00080000:0.0:1788873697.528192:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a3100 x1875769859017600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.528227:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859017600:0@lo:400: 00010000:00080000:0.0:1788873697.530508:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a2a00 x1875769859016448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530540:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859016448:0@lo:13: 00010000:00080000:0.0:1788873697.530556:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0700 x1875769859016960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530565:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859016960:0@lo:400: 00010000:00080000:0.0:1788873697.530575:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0380 x1875769859017472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530583:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859017472:0@lo:400: 00000100:00100000:0.0:1788873697.530644:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859016832:0@lo:400: 00010000:00080000:0.0:1788873697.530657:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a3480 x1875769859017344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530666:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859017344:0@lo:400: 00010000:00080000:0.0:1788873697.530677:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a1880 x1875769859016704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530685:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859016704:0@lo:400: 00010000:00080000:0.0:1788873697.530695:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a2680 x1875769859017216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530703:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859017216:0@lo:400: 00010000:00080000:0.0:1788873697.530727:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427e9180 x1875769859017728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873697.530738:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859017728:0@lo:13: 00000020:01000004:3.0:1788873698.359505:0:9505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788873698.359509:0:9505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788873698.359510:0:9505:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788873698.359657:0:9505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3341ecd800 00000020:01000004:3.0:1788873698.359672:0:9505:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788873698.359686:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788873698.359699:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d347a793380) 00000020:00000080:3.0:1788873698.359716:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788873698.391521:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788873698.392347:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:1.0:1788873698.416114:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:3.0:1788873698.429080:0:9505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788873698.429333:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788873698.429351:0:9505:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788873698.429366:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c660afb0a9b47f 00000020:01000004:3.0:1788873698.429373:0:9505:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788873698.429396:0:9505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788873698.429400:0:9505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788873698.429407:0:9505:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788873698.429434:0:9505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788873698.429438:0:9505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788873698.454003:0:9505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788873698.454042:0:9505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.120@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788873698.454046:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788873698.454048:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873698.454049:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873698.454050:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873698.454052:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873698.454053:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873698.454054:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873698.454056:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788873698.454057:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788873698.454058:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873698.454060:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788873698.454064:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788873698.454067:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788873698.454068:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873698.454069:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873698.454070:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873698.454072:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873698.454073:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873698.454074:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873698.454075:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788873698.454076:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788873698.454077:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873698.454081:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788873698.454107:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788873698.454125:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859017856:0@lo:253: 00000100:00100000:2.0:1788873698.454194:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873698.454487:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584f63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873698.454948:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017856 00000100:00100000:1.0:1788873698.454958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017856 00000100:00100000:1.0:1788873698.459623:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788873698.459650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:9505:x1875769859017856:12345-0@lo:253: 20000000:01000000:1.0:1788873698.459696:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788873698.459701:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788873698.459707:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788873698.459712:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788873698.460060:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873698.460222:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788873698.460240:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788873698.460258:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788873698.460263:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788873698.460276:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788873698.460291:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788873698.460368:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788873698.460382:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.120@tcp 20000000:01000000:1.0:1788873698.460384:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788873698.460403:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788873698.460408:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788873698.460420:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788873698.460425:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:1.0:1788873698.460437:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788873698.460441:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788873698.460452:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788873698.460465:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788873698.460523:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788873698.460532:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.120@tcp 20000000:01000000:1.0:1788873698.460534:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788873698.460547:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788873698.460552:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788873698.460565:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788873698.460569:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:1.0:1788873698.460579:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788873698.460583:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788873698.460593:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788873698.460605:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788873698.461036:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788873698.461047:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.120@tcp 20000000:01000000:1.0:1788873698.461049:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788873698.461060:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788873698.461064:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788873698.461075:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788873698.461079:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.120@tcp (null) (null) 00000040:00080000:1.0:1788873698.461089:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788873698.461093:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788873698.461103:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788873698.461115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788873698.461134:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788873698.461137:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788873698.461141:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788873698.461180:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788873698.461183:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788873698.464007:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788873698.464324:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788873698.464355:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788873698.464370:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788873698.464380:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788873698.464383:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788873698.464921:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788873698.464945:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788873698.464960:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788873698.465107:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788873698.465127:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788873698.465162:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788873698.465175:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788873698.465178:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788873698.465663:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788873698.465692:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788873698.465705:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788873698.465827:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788873698.465848:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788873698.465863:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788873698.465871:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788873698.465873:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788873698.466361:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788873698.466384:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788873698.466400:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788873698.466666:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788873698.466689:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788873698.466703:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788873698.466713:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788873698.466715:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788873698.467132:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788873698.467153:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788873698.467169:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788873698.467289:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788873698.467309:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788873698.467325:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1788873698.467341:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788873698.467364:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467384:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467392:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467399:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467417:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467423:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467430:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467437:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467444:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467484:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467499:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 21 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.467514:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859017984:0@lo:104: 00000100:00100000:2.0:1788873698.467599:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873698.467662:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467671:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 21 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.467678:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018112:0@lo:104: 00000100:00100000:2.0:1788873698.467707:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873698.467750:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467758:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 21 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.467766:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018240:0@lo:104: 00000100:00100000:3.0:1788873698.467782:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859017984 00000100:00100000:2.0:1788873698.467786:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.467790:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859017984 00010000:00010000:2.0:1788873698.467801:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467808:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 21 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.467815:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018368:0@lo:104: 00000100:00100000:3.0:1788873698.467822:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018112 00000100:00100000:3.0:1788873698.467824:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018112 00000100:00100000:3.0:1788873698.467833:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018240 00000100:00100000:3.0:1788873698.467836:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018240 00000100:00100000:2.0:1788873698.467846:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.467849:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873698.467857:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6506:x1875769859017984:12345-0@lo:104: 00010000:00010000:2.0:1788873698.467862:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.467869:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467869:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 21 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.467877:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018496:0@lo:104: 00000100:00100000:2.0:1788873698.467894:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873698.467909:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467916:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 21 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.467924:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788873698.467930:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6506:x1875769859017984:12345-0@lo:104: Request processed in 75us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873698.467935:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018624:0@lo:104: 00000100:00100000:3.0:1788873698.467937:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873698.467952:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018368 00000100:00100000:3.0:1788873698.467955:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018368 00000100:00100000:2.0:1788873698.467957:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.467971:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788873698.467980:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018496 00000100:00100000:3.0:1788873698.467982:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018496 00010000:00010000:2.0:1788873698.467982:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.467991:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 21 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.467992:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018624 00000100:00100000:3.0:1788873698.467999:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018624 00000100:00100000:2.0:1788873698.467999:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018752:0@lo:104: 00000100:00100000:3.0:1788873698.468014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788873698.468018:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.468019:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6506:x1875769859018112:12345-0@lo:104: 00010000:00010000:3.0:1788873698.468027:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.468028:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff300 going to sleep for 11 seconds 00000100:00100000:2.0:1788873698.468045:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859017984:0@lo:104: 00000100:00100000:2.0:1788873698.468054:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018112:0@lo:104: 00010000:00010000:3.0:1788873698.468060:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788873698.468064:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6506:x1875769859018112:12345-0@lo:104: Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.468070:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873698.468080:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018752 00000100:00100000:3.0:1788873698.468083:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018752 00000100:00100000:3.0:1788873698.468095:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873698.468100:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6506:x1875769859018240:12345-0@lo:104: 00010000:00010000:3.0:1788873698.468107:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.468142:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788873698.468147:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:6506:x1875769859018240:12345-0@lo:104: Request processed in 47us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.468153:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873698.468165:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873698.468170:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6506:x1875769859018368:12345-0@lo:104: 00000100:00100000:2.0:1788873698.468175:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018240:0@lo:104: 00010000:00010000:3.0:1788873698.468178:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.468248:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788873698.468254:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:6506:x1875769859018368:12345-0@lo:104: Request processed in 84us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.468266:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873698.468279:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788873698.468285:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6506:x1875769859018496:12345-0@lo:104: 00010000:00010000:3.0:1788873698.468293:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.468322:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788873698.468374:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018368:0@lo:104: 00000100:00100000:2.0:1788873698.468382:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018496:0@lo:104: 00010000:00010000:1.0:1788873698.468421:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788873698.468428:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468436:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873698.468440:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468460:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873698.468467:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873698.468473:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873698.468511:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468518:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873698.468537:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468546:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b46a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b471 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468559:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788873698.468563:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468569:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dd000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873698.468572:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468580:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873698.468587:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873698.468598:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873698.468612:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468618:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873698.468641:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468648:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dd000/0x25c660afb0a9b440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b447 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468657:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788873698.468660:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.468661:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859019008:0@lo:103: 00010000:00010000:1.0:1788873698.468666:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873698.468669:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468675:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873698.468681:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873698.468686:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788873698.468687:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873698.468702:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468708:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788873698.468722:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019008 00000100:00100000:2.0:1788873698.468725:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019008 00010000:00010000:1.0:1788873698.468745:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468752:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.468754:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 22 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468763:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788873698.468766:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468772:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93400 already unused, calling callback (ffffffffc145cc20) 00000100:00100000:2.0:1788873698.468774:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 10000000:00010000:1.0:1788873698.468775:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.468780:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3635:x1875769859019008:12345-0@lo:103: 00010000:00010000:1.0:1788873698.468782:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873698.468789:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873698.468795:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873698.468797:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873698.468802:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 22 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468807:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.468812:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 22 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468813:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873698.468818:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468824:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93400/0x25c660afb0a9b3fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.468825:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b440 expref: 22 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468833:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873698.468837:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873698.468840:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468846:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e800 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873698.468849:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468856:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.468858:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859019008:12345-0@lo:103: Request processed in 78us (170us total) trans 0 rc 0/0 10000000:00010000:1.0:1788873698.468863:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.468864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:01000000:1.0:1788873698.468868:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873698.468880:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468886:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873698.468890:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468896:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215e800/0x25c660afb0a9b3de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.468905:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873698.468906:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873698.468908:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873698.468920:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859018880:0@lo:103: 00000100:00100000:1.0:1788873698.468946:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873698.468972:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859019392:0@lo:103: 00000100:00100000:1.0:1788873698.469001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873698.469019:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873698.469025:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859019264:0@lo:103: 00000100:00100000:1.0:1788873698.469046:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873698.469071:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859019136:0@lo:103: 00000100:00100000:1.0:1788873698.469093:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873698.469114:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859018880 00000100:00100000:1.0:1788873698.469118:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859018880 00010000:00010000:1.0:1788873698.469146:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 21 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873698.469158:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019392 00000100:00100000:1.0:1788873698.469161:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019392 00010000:00010000:1.0:1788873698.469172:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 22 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873698.469182:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019264 00000100:00100000:1.0:1788873698.469184:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019264 00010000:00010000:1.0:1788873698.469193:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 23 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873698.469201:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019136 00000100:00100000:1.0:1788873698.469222:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019136 00010000:00010000:1.0:1788873698.469233:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 24 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873698.469246:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788873698.469251:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859018880:12345-0@lo:103: 00010000:00010000:1.0:1788873698.469258:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873698.469262:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 24 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469278:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 24 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469289:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeb000/0x25c660afb0a9b471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b46a expref: 24 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469298:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873698.469315:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788873698.469322:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788873698.469499:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3634:x1875769859018880:12345-0@lo:103: Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.469508:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788873698.469524:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788873698.469531:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3634:x1875769859019392:12345-0@lo:103: 00010000:00010000:1.0:1788873698.469540:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873698.469544:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 22 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469554:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 22 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469565:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93200/0x25c660afb0a9b3e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b3de expref: 22 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469574:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873698.469598:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3634:x1875769859019392:12345-0@lo:103: Request processed in 68us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.469604:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788873698.469616:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788873698.469621:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458497c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3634:x1875769859019264:12345-0@lo:103: 00010000:00010000:1.0:1788873698.469636:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873698.469641:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 20 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469649:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 20 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469658:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b3fa expref: 20 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469665:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873698.469688:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458497c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3634:x1875769859019264:12345-0@lo:103: Request processed in 67us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.469694:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788873698.469741:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873698.469749:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3636:x1875769859019136:12345-0@lo:103: 00010000:00010000:1.0:1788873698.469756:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873698.469760:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469769:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469779:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93600/0x25c660afb0a9b42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b424 expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.469787:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873698.469821:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3636:x1875769859019136:12345-0@lo:103: Request processed in 73us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.469827:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873698.469866:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859019008:0@lo:103: 00000100:00100000:1.0:1788873698.469890:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859019264:0@lo:103: 00000100:00100000:1.0:1788873698.469898:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859018880:0@lo:103: 00000100:00100000:1.0:1788873698.469905:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859019392:0@lo:103: 00000100:00100000:3.0:1788873698.469970:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:6506:x1875769859018496:12345-0@lo:104: Request processed in 1683us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.469979:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788873698.469997:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873698.470005:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342549450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6506:x1875769859018624:12345-0@lo:104: 00010000:00010000:3.0:1788873698.470015:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470066:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788873698.470072:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342549450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6506:x1875769859018624:12345-0@lo:104: Request processed in 70us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.470079:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873698.470106:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788873698.470112:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6506:x1875769859018752:12345-0@lo:104: 00010000:00010000:3.0:1788873698.470120:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470144:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788873698.470148:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6506:x1875769859018752:12345-0@lo:104: Request processed in 37us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.470161:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788873698.470178:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788873698.470184:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470320:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfeb400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873698.470388:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470399:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873698.470406:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873698.470411:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873698.470437:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470444:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873698.470456:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470463:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb400/0x25c660afb0a9b39f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3a6 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470473:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873698.470476:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470493:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873698.470496:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470504:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873698.470510:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873698.470515:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873698.470528:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470534:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873698.470539:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470546:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215e000/0x25c660afb0a9b375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b37c expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470560:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873698.470562:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873698.470564:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873698.470575:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859019520:0@lo:103: 00000100:00100000:3.0:1788873698.470607:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.470641:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873698.470648:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859019648:0@lo:103: 00000100:00100000:3.0:1788873698.470681:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.470707:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019520 00000100:00100000:3.0:1788873698.470712:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019520 00010000:00010000:3.0:1788873698.470745:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 17 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.470760:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019648 00000100:00100000:3.0:1788873698.470763:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019648 00010000:00010000:3.0:1788873698.470774:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 18 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.470786:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873698.470792:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3635:x1875769859019520:12345-0@lo:103: 00010000:00010000:3.0:1788873698.470800:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873698.470805:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 18 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470815:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 18 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470826:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873698.470851:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3635:x1875769859019520:12345-0@lo:103: Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.470859:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873698.470871:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788873698.470876:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3635:x1875769859019648:12345-0@lo:103: 00010000:00010000:3.0:1788873698.470883:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873698.470888:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 17 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470907:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 17 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470919:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470926:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470940:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470947:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470954:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470961:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470968:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215f800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873698.470972:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470979:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.470988:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.471009:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873698.471032:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3635:x1875769859019648:12345-0@lo:103: Request processed in 157us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.471040:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788873698.471068:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859019648:0@lo:103: 00000100:00100000:3.0:1788873698.471078:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859019520:0@lo:103: 00000100:00100000:2.0:1788873698.471367:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859019136:0@lo:103: 00010000:00010000:1.0:1788873698.472629:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b3a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b39f expref: 16 pid: 6503 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873698.472647:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018624:0@lo:104: 00010000:00010000:1.0:1788873698.472659:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b37c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b375 expref: 15 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873698.472668:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875769859018752:0@lo:104: 00010000:00010000:1.0:1788873698.472705:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.472714:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.472721:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.472728:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b486 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788873698.472751:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788873698.472877:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873698.475705:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:9505:x1875769859017856:12345-0@lo:253: Request processed in 16061us (21501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.475720:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788873698.475824:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859017856:0@lo:253: 10000000:01000000:0.0:1788873698.475839:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788873698.475843:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788873698.475845:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788873698.475846:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873698.475847:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788873698.475848:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873698.475849:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873698.475851:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788873698.475852:0:9505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788873698.475853:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873698.475855:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788873698.475874:0:9505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3341ecd800 from lustre-OST0001 10000000:01000000:0.0:1788873698.475900:0:9505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788873698.475903:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788873698.475912:0:9505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3480da19c0 local copy 10000000:01000000:0.0:1788873698.475916:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788873698.475954:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.475966:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.475976:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873698.475997:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859019776:0@lo:101: 00000100:00100000:0.0:1788873698.476039:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873698.476129:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33428473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873698.482149:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019776 00000100:00100000:2.0:1788873698.482166:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019776 00000100:00100000:2.0:1788873698.482272:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788873698.482284:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:9505:x1875769859019776:12345-0@lo:101: 00010000:00010000:2.0:1788873698.482303:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873698.482336:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215ec00/0x25c660afb0a9b494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b48d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.482364:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215ec00/0x25c660afb0a9b494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b48d expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.482376:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215ec00/0x25c660afb0a9b494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b48d expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.482399:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ec00, rc 0) 00000100:00100000:2.0:1788873698.482479:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859019776:12345-0@lo:101: Request processed in 198us (6439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873698.482486:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788873698.482574:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859019776:0@lo:101: 00010000:00010000:2.0:1788873698.482594:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.482604:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873698.482720:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859019904:0@lo:501: 00000100:00100000:2.0:1788873698.482769:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873698.482799:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873698.482894:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859019904 00000100:00100000:1.0:1788873698.482900:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859019904 00000100:00100000:1.0:1788873698.482935:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788873698.482943:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859019904:12345-0@lo:501: 00000100:00100000:1.0:1788873698.483001:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859019904:12345-0@lo:501: Request processed in 59us (232us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788873698.483009:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788873698.487290:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859019904:0@lo:501: 10000000:01000000:3.0:1788873698.487335:0:9505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788873698.487389:0:9505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788873698.487399:0:9505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.487411:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.487418:0:9505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.487443:0:9505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788873698.487478:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3341ecd800 10000000:01000000:3.0:1788873698.487485:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788873698.487492:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788873698.487495:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788873698.487499:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788873698.487502:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788873698.487551:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.487560:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.487571:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.487590:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020032:0@lo:101: 00000100:00100000:3.0:1788873698.487656:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.487764:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788873698.487909:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873698.487916:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.487924:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93c00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873698.487928:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.487938:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873698.487946:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873698.487952:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873698.487975:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.487982:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873698.488001:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.488008:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b48d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c660afb0a9b494 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.488028:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873698.488030:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873698.488031:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873698.488053:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859020160:0@lo:103: 00000100:00100000:1.0:1788873698.488083:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873698.488122:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020160 00000100:00100000:1.0:1788873698.488129:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020160 00000100:00100000:1.0:1788873698.488177:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873698.488186:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3633:x1875769859020160:12345-0@lo:103: 00010000:00010000:1.0:1788873698.488200:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873698.488236:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215ec00/0x25c660afb0a9b494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b48d expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873698.488252:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873698.488286:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:3633:x1875769859020160:12345-0@lo:103: Request processed in 101us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.488293:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873698.488337:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859020160:0@lo:103: 00000100:00100000:0.0:1788873698.488448:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020032 00000100:00100000:0.0:1788873698.488453:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020032 00000100:00100000:0.0:1788873698.488490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788873698.488497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+14:9505:x1875769859020032:12345-0@lo:101: 00010000:00010000:0.0:1788873698.488509:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873698.488522:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b49b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.488542:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.488553:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.488561:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93800, rc 0) 00000100:00100000:0.0:1788873698.488594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020032:12345-0@lo:101: Request processed in 98us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.488600:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788873698.488716:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020032:0@lo:101: 00010000:00010000:3.0:1788873698.488730:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.488751:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.488863:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020288:0@lo:501: 00000100:00100000:3.0:1788873698.488891:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.488914:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873698.489048:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020288 00000100:00100000:0.0:1788873698.489053:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020288 00000100:00100000:0.0:1788873698.489080:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788873698.489087:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020288:12345-0@lo:501: 00000100:00100000:0.0:1788873698.489199:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020288:12345-0@lo:501: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.489232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788873698.491183:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020288:0@lo:501: 00000100:00100000:3.0:1788873698.491429:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020416:0@lo:503: 00000100:00100000:3.0:1788873698.491511:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.491561:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873698.491621:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020416 00000100:00100000:0.0:1788873698.491629:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020416 00000100:00100000:0.0:1788873698.491690:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788873698.491708:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020416:12345-0@lo:503: 00000100:00100000:0.0:1788873698.491838:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020416:12345-0@lo:503: Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.491846:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788873698.492101:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020416:0@lo:503: 00000040:00080000:3.0:1788873698.492487:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873698.492581:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020544:0@lo:502: 00000100:00100000:3.0:1788873698.492626:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.492644:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873698.492749:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020544 00000100:00100000:0.0:1788873698.492754:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020544 00000100:00100000:0.0:1788873698.492792:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788873698.492800:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020544:12345-0@lo:502: 00000100:00100000:0.0:1788873698.492896:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020544:12345-0@lo:502: Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.492903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788873698.493006:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020544:0@lo:502: 00000040:00080000:3.0:1788873698.493186:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788873698.493381:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788873698.493396:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788873698.493406:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788873698.493417:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788873698.493428:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788873698.493449:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020672:0@lo:502: 00000100:00100000:3.0:1788873698.493485:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.493632:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873698.493685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020672 00000100:00100000:1.0:1788873698.493691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020672 00000100:00100000:1.0:1788873698.493773:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788873698.493781:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020672:12345-0@lo:502: 00000100:00100000:1.0:1788873698.493880:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020672:12345-0@lo:502: Request processed in 100us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873698.493888:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788873698.493952:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020672:0@lo:502: 00000040:00080000:3.0:1788873698.493992:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788873698.494000:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788873698.494691:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788873698.494699:0:9517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788873698.494706:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873698.494708:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788873698.494715:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873698.494730:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d3342964d40) 00000020:00000080:2.0:1788873698.494764:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788873698.494771:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788873698.494852:0:9517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3341ecd800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788873698.494861:0:9517:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788873698.494868:0:9517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c660afb0a9b4b0 00010000:00010000:2.0:1788873698.499833:0:9517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788873698.500132:0:9517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788873698.504621:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788873698.505099:0:9517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788873698.513595:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788873698.513807:0:9517:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788873698.519929:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788873698.523717:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788873698.523740:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873698.523748:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873698.523750:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788873698.523756:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873698.523760:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873698.523762:0:9517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788873698.523765:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788873698.523767:0:9517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788873698.523792:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873698.523795:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873698.523797:0:9517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788873698.523800:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788873698.528174:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788873698.528244:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788873698.528262:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528275:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873698.528284:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3341ecd800 from 1 10000000:01000000:3.0:1788873698.528287:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788873698.528329:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528355:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528367:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.528391:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020800:0@lo:101: 00000100:00100000:3.0:1788873698.528457:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.528500:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.528526:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020800 00000100:00100000:3.0:1788873698.528544:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020800 00000100:00100000:3.0:1788873698.528591:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788873698.528598:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859020800:12345-0@lo:101: 00010000:00010000:3.0:1788873698.528612:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873698.528625:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b4b7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528648:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528660:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528669:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d34821dd000, rc 0) 00000100:00100000:3.0:1788873698.528706:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859020800:12345-0@lo:101: Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.528713:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788873698.528777:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020800:0@lo:101: 00010000:00010000:3.0:1788873698.528798:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.528807:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.528894:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020928:0@lo:501: 00000100:00100000:3.0:1788873698.528920:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.528935:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.528950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859020928 00000100:00100000:3.0:1788873698.528954:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859020928 00000100:00100000:3.0:1788873698.528978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873698.528985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859020928:12345-0@lo:501: 00000100:00100000:3.0:1788873698.529079:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859020928:12345-0@lo:501: Request processed in 94us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.529086:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873698.529118:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859020928:0@lo:501: 00000100:00100000:3.0:1788873698.529142:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021056:0@lo:503: 00000100:00100000:3.0:1788873698.529181:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.529194:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.529226:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021056 00000100:00100000:3.0:1788873698.529230:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021056 00000100:00100000:3.0:1788873698.529253:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788873698.529259:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021056:12345-0@lo:503: 00000100:00100000:3.0:1788873698.529335:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021056:12345-0@lo:503: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.529342:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788873698.529404:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021056:0@lo:503: 00000040:00080000:3.0:1788873698.529675:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873698.529776:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021184:0@lo:502: 00000100:00100000:3.0:1788873698.529812:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.529831:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.529845:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021184 00000100:00100000:3.0:1788873698.529849:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021184 00000100:00100000:3.0:1788873698.529872:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788873698.529878:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021184:12345-0@lo:502: 00000100:00100000:3.0:1788873698.529942:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021184:12345-0@lo:502: Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.529949:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788873698.529984:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021184:0@lo:502: 00000040:00080000:3.0:1788873698.530143:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788873698.530164:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788873698.530180:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021312:0@lo:502: 00000100:00100000:3.0:1788873698.530233:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.530246:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345845f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.530259:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021312 00000100:00100000:3.0:1788873698.530262:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021312 00000100:00100000:3.0:1788873698.530280:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788873698.530286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021312:12345-0@lo:502: 00000100:00100000:3.0:1788873698.530341:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021312:12345-0@lo:502: Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.530347:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788873698.530380:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021312:0@lo:502: 00000040:00080000:3.0:1788873698.530415:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788873698.530421:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788873698.541072:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873698.541089:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873698.541092:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788873698.541103:0:9520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3341ecd800 00000020:00000080:2.0:1788873698.541107:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788873698.541119:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873698.541122:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873698.541124:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788873698.541127:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788873698.542947:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788873698.542990:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873698.543016:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543031:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873698.543093:0:9505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788873698.543096:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3341ecd800 10000000:01000000:3.0:1788873698.543099:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3341ecd800 10000000:01000000:3.0:1788873698.543104:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788873698.543110:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3341ecd800 from 1 10000000:01000000:3.0:1788873698.543113:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788873698.543153:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543163:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543175:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.543225:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021440:0@lo:101: 00000100:00100000:3.0:1788873698.543296:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.543334:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.543356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021440 00000100:00100000:3.0:1788873698.543363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021440 00000100:00100000:3.0:1788873698.543421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788873698.543431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9505:x1875769859021440:12345-0@lo:101: 00010000:00010000:3.0:1788873698.543446:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873698.543457:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b4c5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543482:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543494:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543502:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d34821dc400, rc 0) 00000100:00100000:3.0:1788873698.543555:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021440:12345-0@lo:101: Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.543562:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788873698.543611:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021440:0@lo:101: 00010000:00010000:3.0:1788873698.543626:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.543636:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.543716:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021568:0@lo:501: 00000100:00100000:3.0:1788873698.543756:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.543771:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.543786:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021568 00000100:00100000:3.0:1788873698.543789:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021568 00000100:00100000:3.0:1788873698.543811:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788873698.543825:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021568:12345-0@lo:501: 00000100:00100000:3.0:1788873698.543922:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021568:12345-0@lo:501: Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.543929:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788873698.543960:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021568:0@lo:501: 00000100:00100000:3.0:1788873698.543983:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021696:0@lo:503: 00000100:00100000:3.0:1788873698.544021:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.544034:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3475ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.544048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021696 00000100:00100000:3.0:1788873698.544051:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021696 00000100:00100000:3.0:1788873698.544072:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788873698.544078:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021696:12345-0@lo:503: 00000100:00100000:3.0:1788873698.544153:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021696:12345-0@lo:503: Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.544160:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788873698.544224:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021696:0@lo:503: 00000040:00080000:3.0:1788873698.544461:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873698.544533:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021824:0@lo:502: 00000100:00100000:3.0:1788873698.544570:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.544586:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442da9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788873698.544599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021824 00000100:00100000:3.0:1788873698.544603:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021824 00000100:00100000:3.0:1788873698.544625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788873698.544631:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021824:12345-0@lo:502: 00000100:00100000:3.0:1788873698.544714:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021824:12345-0@lo:502: Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.547397:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021824:0@lo:502: 00000040:00080000:0.0:1788873698.547717:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788873698.547763:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788873698.547779:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788873698.547793:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788873698.547807:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788873698.547838:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788873698.547855:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788873698.547869:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788873698.547883:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788873698.547895:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788873698.547902:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788873698.547909:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788873698.547915:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788873698.547921:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788873698.547928:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788873698.547934:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788873698.547950:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788873698.547957:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788873698.547963:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788873698.547970:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788873698.547976:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788873698.547998:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788873698.548012:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788873698.548025:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788873698.548037:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788873698.548050:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788873698.548061:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788873698.548068:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788873698.548074:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788873698.548081:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788873698.548087:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788873698.548094:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788873698.548100:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788873698.548107:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788873698.548113:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788873698.548120:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788873698.548127:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788873698.548144:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788873698.548152:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788873698.548158:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788873698.548165:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788873698.548172:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788873698.548178:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788873698.548185:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788873698.548192:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788873698.548198:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788873698.548308:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788873698.549039:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021952:0@lo:502: 00000100:00100000:0.0:1788873698.549113:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873698.549223:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859022080:0@lo:41: 00000100:00100000:1.0:1788873698.549262:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.549345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022080 00000100:00100000:3.0:1788873698.549355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022080 00000100:00100000:3.0:1788873698.549410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788873698.549421:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859022080:12345-0@lo:41: 00000004:00000024:3.0:1788873698.549454:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788873698.549499:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859022080:12345-0@lo:41: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.549506:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788873698.549540:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859022080:0@lo:41: 00000100:00100000:0.0:1788873698.549642:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33428479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873698.549861:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859021952 00000100:00100000:2.0:1788873698.549866:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859021952 00000100:00100000:2.0:1788873698.549901:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788873698.549908:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021952:12345-0@lo:502: 00000100:00100000:2.0:1788873698.550052:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859021952:12345-0@lo:502: Request processed in 144us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873698.550059:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788873698.550640:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859021952:0@lo:502: 00000040:00080000:3.0:1788873698.550727:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788873698.550759:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788873698.551175:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788873698.551187:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d347a7919c0) 00000020:00000080:3.0:1788873698.551361:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788873698.551442:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3341ecd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788873698.551445:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3341ecd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788873698.551447:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3341ecd800 3 00010000:00080000:3.0:1788873698.551469:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d33435fe800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.120@tcp at head 00010000:00010000:3.0:1788873698.553943:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788873698.554241:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788873698.554290:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788873698.554305:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x25c660afb0a9b4da 00000100:00080000:3.0:1788873698.554320:0:9522:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873698.554328:0:9522:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d33435fe800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873698.554365:0:9522:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d33427ebb80 x1875769859022208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788873698.554453:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859022208:0@lo:38: 00000100:00100000:1.0:1788873698.554537:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873698.554628:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022208 00000100:00100000:2.0:1788873698.554636:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022208 00000100:00100000:2.0:1788873698.554672:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788873698.554687:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1875769859022208:12345-0@lo:38: 00010000:00080000:2.0:1788873698.554712:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:2.0:1788873698.554756:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x25c660afb0a9b4e1 00000004:00100000:2.0:1788873698.554773:0:8450:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788873698.554808:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9d347a75f800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788873698.554864:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788873698.554958:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859022336:0@lo:400: 00000100:00100000:3.0:1788873698.554991:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555013:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859022848:0@lo:400: 00000100:00100000:3.0:1788873698.555033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555053:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788873698.555059:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859022464:0@lo:400: 00000100:00100000:3.0:1788873698.555096:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555114:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859022976:0@lo:400: 00000100:00100000:3.0:1788873698.555136:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555161:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859022592:0@lo:400: 00000100:00100000:3.0:1788873698.555183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555198:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859023104:0@lo:400: 00000100:00100000:3.0:1788873698.555248:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555267:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873698.555273:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859022720:0@lo:400: 00000100:00100000:3.0:1788873698.555293:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.555317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022336 00000100:00100000:3.0:1788873698.555321:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022336 00000100:00100000:3.0:1788873698.555345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022848 00000100:00100000:3.0:1788873698.555348:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022848 00000100:00100000:3.0:1788873698.555359:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022592 00000100:00100000:3.0:1788873698.555361:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022592 00000100:00100000:3.0:1788873698.555370:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022720 00000100:00100000:3.0:1788873698.555372:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022720 00000100:00100000:3.0:1788873698.555384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873698.555391:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859022336:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555436:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859022336:12345-0@lo:400: Request processed in 45us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555443:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873698.555457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873698.555463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859022848:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555488:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859022848:12345-0@lo:400: Request processed in 26us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873698.555503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788873698.555507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859022592:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859022592:12345-0@lo:400: Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555541:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788873698.555551:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788873698.555557:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859022720:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555582:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859022720:12345-0@lo:400: Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555587:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788873698.555608:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022464 00000100:00100000:3.0:1788873698.555612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022464 00000100:00100000:3.0:1788873698.555635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788873698.555641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859022464:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555670:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859022464:12345-0@lo:400: Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555676:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788873698.555692:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859022976 00000100:00100000:3.0:1788873698.555700:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859022976 00000100:00100000:3.0:1788873698.555723:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023104 00000100:00100000:3.0:1788873698.555725:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023104 00000100:00100000:3.0:1788873698.555755:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873698.555761:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859022976:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555791:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859022976:12345-0@lo:400: Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555797:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873698.555808:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788873698.555813:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859023104:12345-0@lo:400: 00000100:00100000:3.0:1788873698.555837:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859023104:12345-0@lo:400: Request processed in 24us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.555842:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788873698.555890:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427e8e00 x1875769859022720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.555904:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859022720:0@lo:400: 00010000:00080000:3.0:1788873698.555914:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427e9500 x1875769859022592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.555922:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859022592:0@lo:400: 00010000:00080000:3.0:1788873698.555931:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427e9880 x1875769859023104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.555938:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859023104:0@lo:400: 00000100:00100000:3.0:1788873698.555971:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859022464:0@lo:400: 00010000:00080000:3.0:1788873698.555980:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427e9180 x1875769859022976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.556001:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859022976:0@lo:400: 00010000:00080000:3.0:1788873698.556016:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427ea680 x1875769859022336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.556023:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859022336:0@lo:400: 00010000:00080000:3.0:1788873698.556032:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427e9c00 x1875769859022848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.556040:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859022848:0@lo:400: 00000020:01000004:3.0:1788873698.556259:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788873698.556282:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d33436cb380) 00000020:00000080:3.0:1788873698.556303:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788873698.556385:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3341ecd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788873698.556389:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3341ecd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788873698.556392:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3341ecd800 3 00010000:00080000:3.0:1788873698.556420:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d33435f8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.120@tcp at head 00010000:00010000:3.0:1788873698.558186:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1788873698.564857:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875769859022208:12345-0@lo:38: Request processed in 10161us (10310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873698.564873:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788873698.565038:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33427ebb80 x1875769859022208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873698.565051:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788873698.565063:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788873698.565073:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788873698.565078:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788873698.565083:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788873698.565089:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859022208:0@lo:38: 00000100:00100000:2.0:1788873698.565283:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1875769859023232:0@lo:901: 00000100:00100000:2.0:1788873698.565343:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873698.565378:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023232 00000100:00100000:2.0:1788873698.565384:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023232 00000100:00100000:2.0:1788873698.565430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873698.565439:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1875769859023232:12345-0@lo:901: 00000100:00100000:2.0:1788873698.565527:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1875769859023232:12345-0@lo:901: Request processed in 90us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873698.565534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788873698.565555:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873698.565567:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff540 going to sleep for 11 seconds 00010000:00080000:2.0:1788873698.565581:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3342b58000 x1875769859023232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788873714 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873698.565590:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1875769859023232:0@lo:901: 00000020:00000080:1.0:1788873698.565976:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788873698.566022:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788873698.566032:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x25c660afb0a9b4ef 00000100:00080000:1.0:1788873698.566040:0:9522:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873698.566045:0:9522:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d33435f8800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873698.566066:0:9522:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f3a4a80 x1875769859023360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873698.566081:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788873698.566131:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3632:1875769859023360:0@lo:38: 00000100:00100000:1.0:1788873698.566185:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.566477:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023360 00000100:00100000:3.0:1788873698.566483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023360 00000100:00100000:3.0:1788873698.566519:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788873698.566525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769859023360:12345-0@lo:38: 00010000:00080000:3.0:1788873698.566547:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:3.0:1788873698.566576:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x25c660afb0a9b4f6 00000004:00100000:3.0:1788873698.566590:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788873698.566619:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9d33435f9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873698.566665:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875769859023360:12345-0@lo:38: Request processed in 140us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.566682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788873698.568113:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a4a80 x1875769859023360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873698.568129:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873698.568139:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788873698.568149:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788873698.568154:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788873698.568157:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33435f8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788873698.568163:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3632:1875769859023360:0@lo:38: 00000040:00080000:3.0:1788873698.568545:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788873698.568854:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788873698.568887:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788873698.568912:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873698.568941:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788873698.568993:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788873698.568996:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873698.568998:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873698.568999:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873698.569000:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873698.569001:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873698.569003:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873698.569004:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788873698.569006:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788873698.569007:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873698.569008:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788873698.569012:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788873698.569014:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788873698.569016:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873698.569017:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873698.569017:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873698.569018:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873698.569020:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873698.569021:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873698.569022:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788873698.569023:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788873698.569023:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873698.569024:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788873698.569048:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788873698.569067:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859023488:0@lo:253: 00000100:00100000:2.0:1788873698.569130:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873698.569170:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1788873698.569192:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023488 00000100:00100000:2.0:1788873698.569198:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023488 00000100:00100000:2.0:1788873698.569263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788873698.569271:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9505:x1875769859023488:12345-0@lo:253: 20000000:01000000:2.0:1788873698.569305:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788873698.569320:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788873698.580512:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788873698.580555:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788873698.580806:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788873698.580812:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788873698.580837:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.580858:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.580868:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.580876:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.580917:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.580933:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 17 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873698.580949:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859023616:0@lo:104: 00000100:00100000:0.0:1788873698.581020:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873698.581080:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.581089:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 17 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873698.581097:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859023744:0@lo:104: 00000100:00100000:0.0:1788873698.581120:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873698.581157:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34580053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873698.581182:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023616 00000100:00100000:0.0:1788873698.581189:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023616 00000100:00100000:0.0:1788873698.581448:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023744 00000100:00100000:0.0:1788873698.581452:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023744 00000100:00100000:0.0:1788873698.581467:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788873698.581476:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6526:x1875769859023616:12345-0@lo:104: 00010000:00010000:0.0:1788873698.581492:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.581548:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873698.581554:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:6526:x1875769859023616:12345-0@lo:104: Request processed in 79us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.581560:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788873698.581578:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788873698.581584:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769859023744:12345-0@lo:104: 00010000:00010000:0.0:1788873698.581592:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873698.581632:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788873698.581638:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:6526:x1875769859023744:12345-0@lo:104: Request processed in 54us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873698.581644:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788873698.581679:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859023616:0@lo:104: 00000100:00100000:0.0:1788873698.581688:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875769859023744:0@lo:104: 00010000:00010000:0.0:1788873698.581707:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582155:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788873698.582165:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582173:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873698.582178:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582187:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873698.582194:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873698.582200:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873698.582256:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582270:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873698.582288:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582295:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b439 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582306:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873698.582309:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582315:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873698.582318:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582324:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873698.582330:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873698.582336:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873698.582349:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582355:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873698.582369:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582376:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b3ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b3f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582404:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873698.582405:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873698.582415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873698.582430:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859023872:0@lo:103: 00000100:00100000:3.0:1788873698.582470:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.582517:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859024000:0@lo:103: 00000100:00100000:3.0:1788873698.582539:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873698.582568:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859023872 00000100:00100000:3.0:1788873698.582574:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859023872 00010000:00010000:3.0:1788873698.582597:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 18 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.582618:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024000 00000100:00100000:3.0:1788873698.582620:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024000 00010000:00010000:3.0:1788873698.582632:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 19 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.582650:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788873698.582658:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3634:x1875769859023872:12345-0@lo:103: 00010000:00010000:3.0:1788873698.582670:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873698.582675:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 19 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582686:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 19 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582701:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b432 expref: 19 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582725:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873698.582772:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3634:x1875769859023872:12345-0@lo:103: Request processed in 115us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.582778:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788873698.582794:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788873698.582800:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3635:x1875769859024000:12345-0@lo:103: 00010000:00010000:3.0:1788873698.582807:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873698.582811:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 17 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582819:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 17 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582828:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b3f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b3ec expref: 17 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582840:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582847:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788873698.582860:0:9516:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012964440s 00010000:00010000:3.0:1788873698.582865:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582873:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582891:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582899:0:9516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582905:0:9516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873698.582910:0:9516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582917:0:9516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582932:0:9516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.582942:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873698.582968:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3635:x1875769859024000:12345-0@lo:103: Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.582975:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788873698.583005:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859023872:0@lo:103: 00000100:00100000:3.0:1788873698.583025:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859024000:0@lo:103: 00010000:00010000:3.0:1788873698.583042:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.583050:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873698.583057:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92200/0x25c660afb0a9b4fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873698.583122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:9505:x1875769859023488:12345-0@lo:253: Request processed in 13851us (13991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873698.583130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:0.0:1788873698.583492:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873698.583696:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9505:1875769859023488:0@lo:253: 10000000:01000000:2.0:1788873698.583708:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788873698.583711:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788873698.583713:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873698.583714:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873698.583715:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873698.583717:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873698.583718:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873698.583720:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873698.583721:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788873698.583722:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788873698.583724:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873698.583725:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788873698.583748:0:9505:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788873698.588658:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788873698.588844:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788873698.589052:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788873698.589388:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788873698.589605:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788873698.589848:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788873698.591702:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788873698.599858:0:9505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788873698.599869:0:9505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788873698.599909:0:9505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788873698.599960:0:9505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788873698.599982:0:9505:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788873698.600011:0:9505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788873698.600985:0:9505:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873698.601189:0:9505:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788873699.440643:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788873699.817053:0:9578:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873699.821129:0:9578:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788873700.465234:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873701.108173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859024128:0@lo:41: 00000100:00100000:2.0:1788873701.108274:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873701.108389:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024128 00000100:00100000:1.0:1788873701.108397:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024128 00000100:00100000:1.0:1788873701.108467:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788873701.108476:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859024128:12345-0@lo:41: 00000004:00000024:1.0:1788873701.108511:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788873701.110739:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859024128:12345-0@lo:41: Request processed in 2253us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873701.110753:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788873701.111100:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859024128:0@lo:41: 00010000:00010000:3.0:1788873701.486497:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873702.512390:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873702.638763:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873702.638791:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859024256:0@lo:13: 00000100:00100000:3.0:1788873702.638860:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873702.638930:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024256 00000100:00100000:3.0:1788873702.638937:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024256 00000100:00100000:3.0:1788873702.639006:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873702.639015:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859024256:12345-0@lo:13: 00002000:00000024:3.0:1788873702.639057:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873702.639102:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859024256:12345-0@lo:13: Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873702.639109:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788873702.639129:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873702.639158:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ebb80 x1875769859024256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873702.639190:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859024256:0@lo:13: 00000100:00100000:0.0:1788873702.639502:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873702.639513:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859024384:0@lo:13: 00000100:00100000:0.0:1788873702.639542:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873702.639602:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024384 00000100:00100000:1.0:1788873702.639607:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024384 00000100:00100000:1.0:1788873702.639648:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788873702.639655:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859024384:12345-0@lo:13: 00002000:00000024:1.0:1788873702.639666:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873702.639711:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859024384:12345-0@lo:13: Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873702.639717:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788873702.639746:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a5f80 x1875769859024384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873702.639759:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859024384:0@lo:13: 00000100:00080000:0.0:1788873702.639799:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788873703.540268:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873703.664706:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873703.664734:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859024512:0@lo:41: 00000100:00100000:0.0:1788873703.664806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873703.674784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024512 00000100:00100000:3.0:1788873703.674806:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024512 00000100:00100000:3.0:1788873703.674875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788873703.674886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859024512:12345-0@lo:41: 00000004:00000024:3.0:1788873703.674929:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788873703.675023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859024512:12345-0@lo:41: Request processed in 139us (10216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873703.675030:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788873703.675093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859024512:0@lo:41: 00000100:00100000:0.0:1788873703.676788:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859024768:0@lo:400: 00000100:00100000:0.0:1788873703.676849:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.676888:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859025280:0@lo:400: 00000100:00100000:0.0:1788873703.676908:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.676930:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859025792:0@lo:400: 00000100:00100000:0.0:1788873703.676955:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.676980:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788873703.676986:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859024896:0@lo:400: 00000100:00100000:0.0:1788873703.677010:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677028:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859025408:0@lo:400: 00000100:00100000:0.0:1788873703.677053:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677161:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024768 00000100:00100000:0.0:1788873703.677169:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024768 00000100:00100000:0.0:1788873703.677237:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025280 00000100:00100000:0.0:1788873703.677241:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025280 00000100:00100000:0.0:1788873703.677267:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025792 00000100:00100000:0.0:1788873703.677270:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025792 00000100:00100000:0.0:1788873703.677284:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873703.677291:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859024768:12345-0@lo:400: 00000100:00100000:0.0:1788873703.677352:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859024768:12345-0@lo:400: Request processed in 61us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.677359:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873703.677377:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873703.677383:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859025280:12345-0@lo:400: 00000100:00100000:0.0:1788873703.677409:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859025280:12345-0@lo:400: Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.677415:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873703.677426:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873703.677432:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859025792:12345-0@lo:400: 00000100:00100000:0.0:1788873703.677457:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859025792:12345-0@lo:400: Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.677463:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873703.677484:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024896 00000100:00100000:0.0:1788873703.677487:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024896 00000100:00100000:0.0:1788873703.677508:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788873703.677514:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859024896:12345-0@lo:400: 00000100:00100000:0.0:1788873703.677541:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859024896:12345-0@lo:400: Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.677546:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788873703.677560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873703.677592:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859025024:0@lo:400: 00000100:00100000:0.0:1788873703.677615:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677632:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859025536:0@lo:400: 00000100:00100000:0.0:1788873703.677666:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677719:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788873703.677732:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859024640:0@lo:400: 00000100:00100000:0.0:1788873703.677760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677781:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859025152:0@lo:400: 00000100:00100000:0.0:1788873703.677802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677815:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859025664:0@lo:400: 00000100:00100000:0.0:1788873703.677837:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873703.677863:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859024640 00000100:00100000:0.0:1788873703.677867:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859024640 00000100:00100000:0.0:1788873703.677895:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788873703.677902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3635:x1875769859024640:12345-0@lo:400: 00000100:00100000:0.0:1788873703.677935:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3635:x1875769859024640:12345-0@lo:400: Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.677941:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788873703.677969:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025024 00000100:00100000:0.0:1788873703.677972:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025024 00000100:00100000:0.0:1788873703.677987:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025152 00000100:00100000:0.0:1788873703.677989:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025152 00000100:00100000:0.0:1788873703.678007:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025664 00000100:00100000:0.0:1788873703.678010:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025664 00000100:00100000:0.0:1788873703.678020:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873703.678025:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859025024:12345-0@lo:400: 00000100:00100000:0.0:1788873703.678052:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859025024:12345-0@lo:400: Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.678058:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873703.678068:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873703.678073:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859025152:12345-0@lo:400: 00000100:00100000:0.0:1788873703.678112:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859025152:12345-0@lo:400: Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.678125:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873703.678137:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788873703.678142:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859025664:12345-0@lo:400: 00000100:00100000:0.0:1788873703.678168:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859025664:12345-0@lo:400: Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873703.678174:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788873703.678188:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873703.678284:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859024896:0@lo:400: 00010000:00080000:1.0:1788873703.678299:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a726a00 x1875769859024768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873703.678308:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859024768:0@lo:400: 00010000:00080000:1.0:1788873703.678318:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a727100 x1875769859025280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873703.678325:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859025280:0@lo:400: 00010000:00080000:1.0:1788873703.678334:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a0e00 x1875769859025792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873703.678348:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859025792:0@lo:400: 00000100:00100000:1.0:1788873703.678390:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859024640:0@lo:400: 00010000:00080000:1.0:1788873703.678399:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a725880 x1875769859025152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873703.678407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859025152:0@lo:400: 00010000:00080000:1.0:1788873703.678415:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a3480 x1875769859025664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873703.678422:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859025664:0@lo:400: 00010000:00080000:1.0:1788873703.678431:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a727b80 x1875769859025024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873703.678437:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859025024:0@lo:400: 00000100:00100000:3.0:1788873703.679507:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025408 00000100:00100000:3.0:1788873703.679519:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025408 00000100:00100000:3.0:1788873703.679565:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025536 00000100:00100000:3.0:1788873703.679568:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025536 00000100:00100000:3.0:1788873703.679596:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788873703.679605:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859025408:12345-0@lo:400: 00000100:00100000:3.0:1788873703.679680:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859025408:12345-0@lo:400: Request processed in 77us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873703.679699:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788873703.679713:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873703.679718:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859025536:12345-0@lo:400: 00000100:00100000:3.0:1788873703.679755:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859025536:12345-0@lo:400: Request processed in 35us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873703.679760:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788873703.679810:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a1880 x1875769859025536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873703.679841:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859025536:0@lo:400: 00010000:00080000:3.0:1788873703.679877:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a2680 x1875769859025408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873703.679886:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859025408:0@lo:400: 00010000:00010000:0.0:1788873704.560526:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873705.583321:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873706.226908:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859025920:0@lo:41: 00000100:00100000:2.0:1788873706.226992:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873706.227113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859025920 00000100:00100000:0.0:1788873706.227125:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859025920 00000100:00100000:0.0:1788873706.227188:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788873706.227226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859025920:12345-0@lo:41: 00000004:00000024:0.0:1788873706.227262:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788873706.227315:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859025920:12345-0@lo:41: Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873706.227322:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788873706.227519:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859025920:0@lo:41: 00000001:02000400:1.0:1788873706.302613:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788873706.606519:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788873707.099750:0:9920:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873707.099939:0:9920:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873707.631265:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873707.758695:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873707.758723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859026048:0@lo:13: 00000100:00100000:0.0:1788873707.758797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873707.758963:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026048 00000100:00100000:3.0:1788873707.758972:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026048 00000100:00100000:3.0:1788873707.759044:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873707.759056:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859026048:12345-0@lo:13: 00002000:00000024:3.0:1788873707.759086:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873707.759134:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859026048:12345-0@lo:13: Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873707.759141:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788873707.760492:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873707.760518:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859026176:0@lo:13: 00000100:00100000:0.0:1788873707.760564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788873707.760600:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ebb80 x1875769859026048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873707.760617:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859026048:0@lo:13: 00000100:00100000:3.0:1788873707.760721:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026176 00000100:00100000:3.0:1788873707.760728:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026176 00000100:00100000:3.0:1788873707.760783:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788873707.760791:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859026176:12345-0@lo:13: 00002000:00000024:3.0:1788873707.760811:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873707.760851:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859026176:12345-0@lo:13: Request processed in 61us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873707.760858:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788873707.760954:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788873707.760972:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59c00 x1875769859026176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873707.760986:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859026176:0@lo:13: 10000000:01000000:0.0:1788873708.270373:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788873708.270383:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3476df3800 from 39 10000000:01000000:0.0:1788873708.270390:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788873708.270442:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.270455:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.270467:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.270491:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026304:0@lo:101: 00000100:00100000:0.0:1788873708.270568:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.270637:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.270975:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026304 00000100:00100000:3.0:1788873708.270986:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026304 00000100:00100000:3.0:1788873708.271059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788873708.271071:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859026304:12345-0@lo:101: 00010000:00010000:3.0:1788873708.271088:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873708.271119:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b504 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.271148:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.271159:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.271169:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442600, rc 0) 00000100:00100000:3.0:1788873708.271245:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859026304:12345-0@lo:101: Request processed in 176us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873708.271252:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788873708.271448:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026304:0@lo:101: 00010000:00010000:1.0:1788873708.271465:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.271474:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873708.271554:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026432:0@lo:501: 00000100:00100000:1.0:1788873708.271592:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.271627:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.271717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026432 00000100:00100000:0.0:1788873708.271721:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026432 00000100:00100000:0.0:1788873708.271759:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788873708.271766:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859026432:12345-0@lo:501: 00000100:00100000:0.0:1788873708.271893:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859026432:12345-0@lo:501: Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.271900:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788873708.275804:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026432:0@lo:501: 00000100:00100000:1.0:1788873708.275890:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026560:0@lo:503: 00000100:00100000:1.0:1788873708.275974:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.276021:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.277260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026560 00000100:00100000:0.0:1788873708.277270:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026560 00000100:00100000:0.0:1788873708.277346:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788873708.277357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859026560:12345-0@lo:503: 00000100:00100000:0.0:1788873708.277506:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859026560:12345-0@lo:503: Request processed in 151us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.277515:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788873708.277717:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026560:0@lo:503: 00000100:00100000:1.0:1788873708.278233:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9972:1875769859026688:0@lo:502: 00000100:00100000:1.0:1788873708.278280:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.278314:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.278366:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026688 00000100:00100000:3.0:1788873708.278371:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026688 00000100:00100000:3.0:1788873708.278397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788873708.278403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9972:x1875769859026688:12345-0@lo:502: 00000100:00100000:3.0:1788873708.278501:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9972:x1875769859026688:12345-0@lo:502: Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873708.278508:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788873708.278621:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9972:1875769859026688:0@lo:502: 00000100:00100000:1.0:1788873708.278680:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9972:1875769859026816:0@lo:502: 00000100:00100000:1.0:1788873708.278714:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.278734:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.278797:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026816 00000100:00100000:2.0:1788873708.278801:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026816 00000100:00100000:2.0:1788873708.278834:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788873708.278840:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9972:x1875769859026816:12345-0@lo:502: 00000100:00100000:2.0:1788873708.278919:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:9972:x1875769859026816:12345-0@lo:502: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.278926:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788873708.279062:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9972:1875769859026816:0@lo:502: 00000040:00080000:1.0:1788873708.279080:0:9972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788873708.279275:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788873708.279296:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788873708.279307:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.279318:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873708.279328:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788873708.279330:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788873708.279333:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788873708.279358:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.279367:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.279375:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.279389:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026944:0@lo:101: 00000100:00100000:0.0:1788873708.279419:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.279448:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.279496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859026944 00000100:00100000:2.0:1788873708.279500:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859026944 00000100:00100000:2.0:1788873708.279528:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788873708.279534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859026944:12345-0@lo:101: 00010000:00010000:2.0:1788873708.279542:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873708.279556:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b512 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.279578:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.279588:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.279596:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873708.279633:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859026944:12345-0@lo:101: Request processed in 100us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.279648:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788873708.279777:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859026944:0@lo:101: 00010000:00010000:1.0:1788873708.279788:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.279797:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873708.279839:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027072:0@lo:501: 00000100:00100000:1.0:1788873708.279875:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.279896:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.279944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027072 00000100:00100000:3.0:1788873708.279949:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027072 00000100:00100000:3.0:1788873708.279978:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788873708.279984:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859027072:12345-0@lo:501: 00000100:00100000:3.0:1788873708.280118:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859027072:12345-0@lo:501: Request processed in 134us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873708.280125:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788873708.282916:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027072:0@lo:501: 00000100:00100000:1.0:1788873708.282988:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027200:0@lo:503: 00000100:00100000:1.0:1788873708.283081:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.283128:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.283247:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027200 00000100:00100000:2.0:1788873708.283255:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027200 00000100:00100000:2.0:1788873708.283310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788873708.283319:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859027200:12345-0@lo:503: 00000100:00100000:2.0:1788873708.283440:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859027200:12345-0@lo:503: Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.283447:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788873708.283629:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027200:0@lo:503: 00000100:00100000:1.0:1788873708.284358:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9973:1875769859027328:0@lo:502: 00000100:00100000:1.0:1788873708.284416:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.284453:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.284503:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027328 00000100:00100000:2.0:1788873708.284508:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027328 00000100:00100000:2.0:1788873708.284542:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788873708.284549:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9973:x1875769859027328:12345-0@lo:502: 00000100:00100000:2.0:1788873708.284681:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9973:x1875769859027328:12345-0@lo:502: Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.284689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788873708.285016:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9973:1875769859027328:0@lo:502: 00000020:01000000:1.0:1788873708.285046:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873708.285055:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873708.285058:0:9973:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788873708.285063:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788873708.285065:0:9973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788873708.285080:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9973:1875769859027456:0@lo:502: 00000100:00100000:1.0:1788873708.285117:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.285141:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.285200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027456 00000100:00100000:3.0:1788873708.285243:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027456 00000100:00100000:3.0:1788873708.285290:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788873708.285297:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9973:x1875769859027456:12345-0@lo:502: 00000100:00100000:3.0:1788873708.285386:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:9973:x1875769859027456:12345-0@lo:502: Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873708.285393:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788873708.285489:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9973:1875769859027456:0@lo:502: 00000020:01000000:1.0:1788873708.285509:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873708.285513:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873708.285515:0:9973:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788873708.285518:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788873708.285776:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788873708.285798:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788873708.285809:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.285820:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873708.285831:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788873708.285834:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34651cb800 from 39 10000000:01000000:3.0:1788873708.285837:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788873708.285866:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.285874:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.285883:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873708.285897:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027584:0@lo:101: 00000100:00100000:3.0:1788873708.285928:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.285958:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584f6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.286009:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027584 00000100:00100000:0.0:1788873708.286020:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027584 00000100:00100000:0.0:1788873708.286060:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788873708.286067:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859027584:12345-0@lo:101: 00010000:00010000:0.0:1788873708.286076:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873708.286088:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b520 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.286111:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.286122:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.286131:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93e00, rc 0) 00000100:00100000:0.0:1788873708.286171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859027584:12345-0@lo:101: Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.286177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788873708.291073:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027584:0@lo:101: 00010000:00010000:3.0:1788873708.291129:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.291143:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873708.291265:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027712:0@lo:501: 00000100:00100000:3.0:1788873708.291327:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.291360:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584f6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.291975:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027712 00000100:00100000:0.0:1788873708.291985:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027712 00000100:00100000:0.0:1788873708.292052:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788873708.292063:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859027712:12345-0@lo:501: 00000100:00100000:0.0:1788873708.292201:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859027712:12345-0@lo:501: Request processed in 140us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.292227:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788873708.292287:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027712:0@lo:501: 00000100:00100000:0.0:1788873708.292327:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027840:0@lo:503: 00000100:00100000:0.0:1788873708.292379:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.292420:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.292452:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027840 00000100:00100000:0.0:1788873708.292456:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027840 00000100:00100000:0.0:1788873708.292483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788873708.292493:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859027840:12345-0@lo:503: 00000100:00100000:0.0:1788873708.292580:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859027840:12345-0@lo:503: Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.292589:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788873708.292655:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859027840:0@lo:503: 00000100:00100000:0.0:1788873708.293060:0:9974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9974:1875769859027968:0@lo:502: 00000100:00100000:0.0:1788873708.293096:0:9974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.293132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859027968 00000100:00100000:0.0:1788873708.293135:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859027968 00000100:00100000:0.0:1788873708.293159:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788873708.293165:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:9974:x1875769859027968:12345-0@lo:502: 00000100:00100000:0.0:1788873708.293264:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:9974:x1875769859027968:12345-0@lo:502: Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.293272:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788873708.293325:0:9974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.293344:0:9974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9974:1875769859027968:0@lo:502: 00000100:00100000:0.0:1788873708.293392:0:9974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9974:1875769859028096:0@lo:502: 00000100:00100000:0.0:1788873708.293431:0:9974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.293455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028096 00000100:00100000:0.0:1788873708.293458:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028096 00000100:00100000:0.0:1788873708.293483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788873708.293492:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:9974:x1875769859028096:12345-0@lo:502: 00000100:00100000:0.0:1788873708.293562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:9974:x1875769859028096:12345-0@lo:502: Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.293576:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788873708.293618:0:9974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442d809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.293635:0:9974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9974:1875769859028096:0@lo:502: 00000040:00080000:0.0:1788873708.293668:0:9974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788873708.293743:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788873708.293782:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788873708.293793:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.293804:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873708.293816:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788873708.293819:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34651cb800 from 6 10000000:01000000:0.0:1788873708.293822:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873708.294573:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.294587:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.294597:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.294614:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028224:0@lo:101: 00000100:00100000:0.0:1788873708.294669:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.296924:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028224 00000100:00100000:2.0:1788873708.296944:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028224 00000100:00100000:2.0:1788873708.297158:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788873708.297171:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859028224:12345-0@lo:101: 00010000:00010000:2.0:1788873708.297195:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873708.297247:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b52e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.297283:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b52e expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.297294:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b52e expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.297304:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215fa00, rc 0) 00000100:00100000:2.0:1788873708.297378:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859028224:12345-0@lo:101: Request processed in 209us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.297385:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788873708.297606:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.297636:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028224:0@lo:101: 00010000:00010000:0.0:1788873708.298182:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.298195:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.298277:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028352:0@lo:256: 00000100:00100000:0.0:1788873708.298326:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.298354:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.298379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028352 00000100:00100000:2.0:1788873708.298387:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028352 00000100:00100000:2.0:1788873708.298468:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788873708.298476:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859028352:12345-0@lo:256: 20000000:01000000:2.0:1788873708.298495:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788873708.298512:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788873708.298515:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788873708.298600:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859028352:12345-0@lo:256: Request processed in 125us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.298608:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788873708.298977:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028352:0@lo:256: 10000000:01000000:0.0:1788873708.299028:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788873708.299034:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.299041:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873708.299049:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788873708.299051:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788873708.299053:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788873708.299073:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.299078:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.299084:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.299103:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028480:0@lo:101: 00000100:00100000:0.0:1788873708.299123:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.299138:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442d809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.299164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028480 00000100:00100000:2.0:1788873708.299169:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028480 00000100:00100000:2.0:1788873708.299272:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788873708.299279:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859028480:12345-0@lo:101: 00010000:00010000:2.0:1788873708.299289:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873708.299299:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b53c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.299318:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.299327:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.299335:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e800, rc 0) 00000100:00100000:2.0:1788873708.299363:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859028480:12345-0@lo:101: Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.299368:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788873708.300001:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028480:0@lo:101: 00010000:00010000:0.0:1788873708.300016:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.300024:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.300080:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028608:0@lo:501: 00000100:00100000:0.0:1788873708.300109:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.300141:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442d809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.303014:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028608 00000100:00100000:2.0:1788873708.303045:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028608 00000100:00100000:2.0:1788873708.303111:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788873708.303121:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859028608:12345-0@lo:501: 00000100:00100000:2.0:1788873708.303322:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859028608:12345-0@lo:501: Request processed in 201us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.303330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788873708.303567:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028608:0@lo:501: 00000100:00100000:0.0:1788873708.303616:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028736:0@lo:503: 00000100:00100000:0.0:1788873708.303726:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.303760:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442d809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.303808:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028736 00000100:00100000:2.0:1788873708.303813:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028736 00000100:00100000:2.0:1788873708.303904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788873708.303913:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859028736:12345-0@lo:503: 00000100:00100000:2.0:1788873708.304081:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859028736:12345-0@lo:503: Request processed in 169us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.304088:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788873708.304824:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859028736:0@lo:503: 00000100:00100000:2.0:1788873708.306432:0:9975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9975:1875769859028864:0@lo:502: 00000100:00100000:2.0:1788873708.306504:0:9975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.306592:0:9975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.318991:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028864 00000100:00100000:3.0:1788873708.319010:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028864 00000100:00100000:3.0:1788873708.319089:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788873708.319100:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:9975:x1875769859028864:12345-0@lo:502: 00000100:00100000:3.0:1788873708.319326:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:9975:x1875769859028864:12345-0@lo:502: Request processed in 227us (12820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873708.319335:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788873708.319786:0:9975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9975:1875769859028864:0@lo:502: 00000020:01000000:2.0:1788873708.319822:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788873708.319830:0:9975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788873708.319836:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873708.319838:0:9975:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788873708.319844:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788873708.319847:0:9975:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:2.0:1788873708.319871:0:9975:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788873708.319874:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873708.319890:0:9975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d3342963380) 00000020:00000080:2.0:1788873708.319914:0:9975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788873708.319918:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788873708.320017:0:9975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788873708.320024:0:9975:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788873708.320032:0:9975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9b551 00010000:00080000:2.0:1788873708.320072:0:9975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d33438f7800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873708.320390:0:9975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788873708.320516:0:9975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788873708.320527:0:9975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788873708.320715:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873708.320825:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873708.320964:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788873708.321047:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788873708.327401:0:9976:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873708.327419:0:9976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788873708.328391:0:9975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788873708.328408:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788873708.328457:0:9975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788873708.328500:0:9975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b558 00000100:00080000:0.0:1788873708.328514:0:9975:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873708.328520:0:9975:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d33438f7800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873708.328558:0:9975:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d33435a1c00 x1875769859028992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873708.328635:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859028992:0@lo:8: 00000100:00100000:3.0:1788873708.328731:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.328824:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859028992 00000100:00100000:1.0:1788873708.328847:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859028992 00000100:00100000:1.0:1788873708.328890:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873708.328900:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3632:x1875769859028992:12345-0@lo:8: 00010000:00080000:1.0:1788873708.328939:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788873708.328969:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9b55f 00002000:00100000:1.0:1788873708.328983:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d3341eae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788873708.328987:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788873708.328992:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788873708.329066:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788873708.329333:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788873708.329359:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d3341eac800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788873708.329808:0:9975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788873708.329908:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873708.329914:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873708.329916:0:9975:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788873708.329919:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873708.329923:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873708.329924:0:9975:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788873708.329927:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788873708.329929:0:9975:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788873708.329958:0:9975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9975:1875769859029120:0@lo:502: 00000100:00100000:0.0:1788873708.330012:0:9975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.330038:0:9975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334275be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.330318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029120 00000100:00100000:2.0:1788873708.330324:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029120 00000100:00100000:2.0:1788873708.330362:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788873708.330370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:9975:x1875769859029120:12345-0@lo:502: 00000100:00100000:2.0:1788873708.330490:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:9975:x1875769859029120:12345-0@lo:502: Request processed in 120us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.330498:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788873708.330546:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859029248:0@lo:400: 00000100:00100000:2.0:1788873708.330575:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330593:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859029760:0@lo:400: 00000100:00100000:2.0:1788873708.330608:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330622:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859030272:0@lo:400: 00000100:00100000:2.0:1788873708.330652:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330680:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788873708.330686:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859029376:0@lo:400: 00000100:00100000:2.0:1788873708.330709:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330724:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859029888:0@lo:400: 00000100:00100000:2.0:1788873708.330755:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330770:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859030400:0@lo:400: 00000100:00100000:2.0:1788873708.330787:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330811:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859029504:0@lo:400: 00000100:00100000:2.0:1788873708.330957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.330972:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859030016:0@lo:400: 00000100:00100000:2.0:1788873708.330994:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.331012:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788873708.331017:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859029632:0@lo:400: 00000100:00100000:2.0:1788873708.331033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.331046:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859030144:0@lo:400: 00000100:00100000:2.0:1788873708.331061:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.331091:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029248 00000100:00100000:2.0:1788873708.331096:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029248 00000100:00100000:2.0:1788873708.331121:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029760 00000100:00100000:2.0:1788873708.331123:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029760 00000100:00100000:2.0:1788873708.331146:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030272 00000100:00100000:2.0:1788873708.331149:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030272 00000100:00100000:2.0:1788873708.331163:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029888 00000100:00100000:2.0:1788873708.331165:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029888 00000100:00100000:2.0:1788873708.331174:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030400 00000100:00100000:2.0:1788873708.331176:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030400 00000100:00100000:2.0:1788873708.331184:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029504 00000100:00100000:2.0:1788873708.331186:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029504 00000100:00100000:2.0:1788873708.331197:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788873708.331222:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859029248:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331259:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859029248:12345-0@lo:400: Request processed in 56us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331275:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788873708.331291:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788873708.331296:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859029760:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331322:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859029760:12345-0@lo:400: Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331328:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788873708.331339:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873708.331344:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859030272:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331368:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859030272:12345-0@lo:400: Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331374:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873708.331389:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873708.331394:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859029888:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331418:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859029888:12345-0@lo:400: Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331423:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873708.331433:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873708.331438:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859030400:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331460:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859030400:12345-0@lo:400: Request processed in 23us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331466:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873708.331479:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788873708.331484:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859029504:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331511:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859029504:12345-0@lo:400: Request processed in 27us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331525:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788873708.331552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029376 00000100:00100000:2.0:1788873708.331556:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029376 00000100:00100000:2.0:1788873708.331577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859029632 00000100:00100000:2.0:1788873708.331580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859029632 00000100:00100000:2.0:1788873708.331592:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788873708.331598:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859029376:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331630:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859029376:12345-0@lo:400: Request processed in 32us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788873708.331657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788873708.331663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859029632:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331685:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859029632:12345-0@lo:400: Request processed in 23us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788873708.331711:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030016 00000100:00100000:2.0:1788873708.331714:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030016 00000100:00100000:2.0:1788873708.331732:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030144 00000100:00100000:2.0:1788873708.331734:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030144 00000100:00100000:2.0:1788873708.331743:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788873708.331749:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859030016:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331773:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859030016:12345-0@lo:400: Request processed in 24us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.331779:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788873708.331788:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788873708.331793:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859030144:12345-0@lo:400: 00000100:00100000:2.0:1788873708.331826:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859030144:12345-0@lo:400: Request processed in 33us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.333125:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788873708.333187:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873708.333193:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873708.333263:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859029632:0@lo:400: 00010000:00080000:2.0:1788873708.333283:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59f80 x1875769859030144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333293:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859030144:0@lo:400: 00010000:00080000:2.0:1788873708.333306:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5a300 x1875769859029504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333315:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859029504:0@lo:400: 00010000:00080000:2.0:1788873708.333326:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b58e00 x1875769859030016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333334:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859030016:0@lo:400: 00000100:00100000:2.0:1788873708.333388:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859029376:0@lo:400: 00010000:00080000:2.0:1788873708.333402:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59500 x1875769859029888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333412:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859029888:0@lo:400: 00010000:00080000:2.0:1788873708.333424:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59180 x1875769859030400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333433:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859030400:0@lo:400: 00010000:00080000:2.0:1788873708.333444:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5bb80 x1875769859029248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333468:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859029248:0@lo:400: 00010000:00080000:2.0:1788873708.333482:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b58380 x1875769859029760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333490:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859029760:0@lo:400: 00010000:00080000:2.0:1788873708.333501:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59c00 x1875769859030272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.333508:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859030272:0@lo:400: 00000100:00100000:1.0:1788873708.333851:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3632:x1875769859028992:12345-0@lo:8: Request processed in 4948us (5117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.333859:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788873708.334051:0:9975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9975:1875769859029120:0@lo:502: 00000020:01000000:0.0:1788873708.334091:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873708.334099:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873708.334101:0:9975:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788873708.334106:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788873708.334318:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788873708.334343:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788873708.334354:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.334364:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873708.334378:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788873708.334380:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34473c7800 from 39 10000000:01000000:1.0:1788873708.334383:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788873708.334420:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.334434:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.334443:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873708.334466:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859030528:0@lo:101: 00000100:00100000:1.0:1788873708.334538:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.334579:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.334624:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030528 00000100:00100000:0.0:1788873708.334631:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030528 00000100:00100000:0.0:1788873708.334687:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788873708.334696:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859030528:12345-0@lo:101: 00010000:00010000:0.0:1788873708.334711:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873708.334727:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b566 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.334757:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.334769:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.334785:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93c00, rc 0) 00000100:00100000:0.0:1788873708.334892:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859030528:12345-0@lo:101: Request processed in 197us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.334899:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788873708.335047:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859030528:0@lo:101: 00010000:00010000:1.0:1788873708.335060:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.335069:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873708.335122:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859030656:0@lo:501: 00000100:00100000:1.0:1788873708.335147:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.335173:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a7a7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.335249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030656 00000100:00100000:2.0:1788873708.335254:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030656 00000100:00100000:2.0:1788873708.335281:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788873708.335288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859030656:12345-0@lo:501: 00000100:00100000:2.0:1788873708.335405:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859030656:12345-0@lo:501: Request processed in 117us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.335412:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788873708.335446:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859030656:0@lo:501: 00000100:00100000:2.0:1788873708.335473:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859030784:0@lo:503: 00000100:00100000:2.0:1788873708.335510:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.335522:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.335532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030784 00000100:00100000:2.0:1788873708.335535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030784 00000100:00100000:2.0:1788873708.335551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788873708.335557:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859030784:12345-0@lo:503: 00000100:00100000:2.0:1788873708.335628:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859030784:12345-0@lo:503: Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.335654:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788873708.335692:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859030784:0@lo:503: 00010000:00080000:3.0:1788873708.336278:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435a1c00 x1875769859028992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873708.336290:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873708.336297:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788873708.336305:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788873708.336310:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788873708.336314:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33438f7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788873708.336326:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788873708.336332:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859028992:0@lo:8: 00000100:00100000:3.0:1788873708.336388:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859030912:0@lo:700: 00000100:00100000:3.0:1788873708.336423:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.336438:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.336505:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859030912 00000100:00100000:2.0:1788873708.336510:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859030912 00000100:00100000:2.0:1788873708.336563:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873708.336572:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9977:x1875769859030912:12345-0@lo:700: 00000100:00100000:2.0:1788873708.336605:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1875769859031040:0@lo:700: 00000100:00100000:2.0:1788873708.336637:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.336666:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.336684:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031040 00000100:00100000:2.0:1788873708.336687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031040 00000100:00100000:2.0:1788873708.336715:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873708.336721:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1875769859031040:12345-0@lo:700: 00000004:00080000:1.0:1788873708.337182:0:9976:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788873708.337316:0:9976:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 245283110862ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788873708.337323:0:9976:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1788873708.337386:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873708.340694:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9978:1875769859031168:0@lo:502: 00000100:00100000:0.0:1788873708.340795:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.340855:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.341027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031168 00000100:00100000:2.0:1788873708.341035:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031168 00000100:00100000:2.0:1788873708.341088:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788873708.341098:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:9978:x1875769859031168:12345-0@lo:502: 00000100:00100000:2.0:1788873708.341269:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:9978:x1875769859031168:12345-0@lo:502: Request processed in 171us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.341276:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788873708.341480:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9978:1875769859031168:0@lo:502: 00000100:00100000:0.0:1788873708.341537:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9978:1875769859031296:0@lo:502: 00000100:00100000:0.0:1788873708.341570:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.341599:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.342685:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031296 00000100:00100000:2.0:1788873708.342696:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031296 00000100:00100000:2.0:1788873708.342748:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788873708.342757:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:9978:x1875769859031296:12345-0@lo:502: 00000100:00100000:2.0:1788873708.342971:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:9978:x1875769859031296:12345-0@lo:502: Request processed in 214us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.342985:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788873708.342993:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9978:1875769859031296:0@lo:502: 00000040:00080000:3.0:1788873708.343033:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000004:00080000:1.0:1788873708.343142:0:7441:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:01000000:2.0:1788873708.343223:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788873708.343250:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788873708.343259:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.343269:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873708.343278:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788873708.343281:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d34473c7800 from 6 10000000:01000000:2.0:1788873708.343283:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788873708.343310:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.343318:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.343328:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873708.343345:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031424:0@lo:101: 00000100:00100000:2.0:1788873708.343379:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.343450:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873708.343533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031424 00000100:00100000:1.0:1788873708.343538:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031424 00000100:00100000:1.0:1788873708.343579:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788873708.343588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859031424:12345-0@lo:101: 00010000:00010000:1.0:1788873708.343607:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873708.343619:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfeb800/0x25c660afb0a9b57b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b574 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.347991:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeb800/0x25c660afb0a9b57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b574 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.348021:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfeb800/0x25c660afb0a9b57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b574 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.348031:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeb800, rc 0) 00000100:00100000:1.0:1788873708.348193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859031424:12345-0@lo:101: Request processed in 4604us (4811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.348217:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788873708.348955:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031424:0@lo:101: 00010000:00010000:3.0:1788873708.348980:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.348991:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873708.349064:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031552:0@lo:256: 00000100:00100000:3.0:1788873708.349110:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.349162:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788873708.352465:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031552 00000100:00100000:1.0:1788873708.352481:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031552 00000100:00100000:1.0:1788873708.352550:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788873708.352560:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859031552:12345-0@lo:256: 20000000:01000000:1.0:1788873708.352584:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788873708.352606:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788873708.352609:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788873708.352769:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859031552:12345-0@lo:256: Request processed in 210us (3657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.352777:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788873708.352808:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031552:0@lo:256: 10000000:01000000:3.0:1788873708.352865:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873708.352876:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.352888:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873708.352896:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788873708.352898:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788873708.352901:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788873708.352962:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.352970:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.352980:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873708.352999:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031680:0@lo:101: 00000100:00100000:3.0:1788873708.353035:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.353078:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.357390:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031680 00000100:00100000:0.0:1788873708.357409:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031680 00000100:00100000:0.0:1788873708.357478:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788873708.357489:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859031680:12345-0@lo:101: 00010000:00010000:0.0:1788873708.357508:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873708.357530:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b582 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.357560:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.357573:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.357583:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92600, rc 0) 00000100:00100000:0.0:1788873708.357701:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859031680:12345-0@lo:101: Request processed in 213us (4664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.357709:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788873708.357743:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031680:0@lo:101: 00010000:00010000:3.0:1788873708.357774:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873708.357788:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873708.357874:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031808:0@lo:501: 00000100:00100000:3.0:1788873708.358195:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.358261:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788873708.358341:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031808 00000100:00100000:1.0:1788873708.358347:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031808 00000100:00100000:1.0:1788873708.358382:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788873708.358389:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859031808:12345-0@lo:501: 00000100:00100000:1.0:1788873708.358516:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859031808:12345-0@lo:501: Request processed in 128us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.358532:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788873708.358547:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031808:0@lo:501: 00000100:00100000:3.0:1788873708.358590:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031936:0@lo:503: 00000100:00100000:3.0:1788873708.358630:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873708.358659:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788873708.358689:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859031936 00000100:00100000:1.0:1788873708.358694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859031936 00000100:00100000:1.0:1788873708.358722:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788873708.358728:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859031936:12345-0@lo:503: 00000100:00100000:1.0:1788873708.358817:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859031936:12345-0@lo:503: Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.358824:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 40000000:02000000:2.0:1788873708.358861:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788873708.358879:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859031936:0@lo:503: 00000100:00100000:1.0:1788873708.360283:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9979:1875769859032064:0@lo:502: 00000100:00100000:1.0:1788873708.360360:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.360400:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442d809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.360469:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032064 00000100:00100000:0.0:1788873708.360475:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032064 00000100:00100000:0.0:1788873708.360509:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788873708.360516:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:9979:x1875769859032064:12345-0@lo:502: 00000100:00100000:0.0:1788873708.360619:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:9979:x1875769859032064:12345-0@lo:502: Request processed in 103us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.360626:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788873708.360727:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9979:1875769859032064:0@lo:502: 00000020:01000000:1.0:1788873708.360756:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788873708.360764:0:9979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788873708.360771:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873708.360773:0:9979:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788873708.360778:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788873708.360782:0:9979:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:1.0:1788873708.360806:0:9979:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788873708.360809:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788873708.360845:0:9979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d33439b0000) 00000020:00000080:1.0:1788873708.360871:0:9979:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788873708.360878:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788873708.360962:0:9979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788873708.360968:0:9979:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788873708.360981:0:9979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9b597 00010000:00080000:1.0:1788873708.361010:0:9979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d347a615000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:1.0:1788873708.361251:0:9979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788873708.361377:0:9979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788873708.361389:0:9979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788873708.361589:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873708.361722:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873708.361842:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788873708.361928:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788873708.363347:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873708.363353:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788873708.364345:0:9979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788873708.364358:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788873708.364396:0:9979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788873708.364424:0:9979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b59e 00000100:00080000:1.0:1788873708.364437:0:9979:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873708.364444:0:9979:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d347a615000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873708.364483:0:9979:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f3a5500 x1875769859032192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873708.364545:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859032192:0@lo:8: 00000100:00100000:3.0:1788873708.364624:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.364874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1875769859031040:12345-0@lo:700: Request processed in 28150us (28234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.364886:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788873708.365068:0:8434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334359c380 x1875769859031040/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.365092:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1875769859031040:0@lo:700: 40000000:02000000:2.0:1788873708.365104:0:8434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00080000:1.0:1788873708.366817:0:9979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788873708.366921:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873708.366929:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873708.366931:0:9979:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788873708.366935:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873708.366939:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873708.366941:0:9979:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788873708.366944:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788873708.366946:0:9979:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788873708.366988:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9979:1875769859032320:0@lo:502: 00000100:00100000:1.0:1788873708.367065:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.367092:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873708.367245:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032320 00000100:00100000:0.0:1788873708.367252:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032320 00000100:00100000:0.0:1788873708.367295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788873708.367304:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:9979:x1875769859032320:12345-0@lo:502: 00000100:00100000:0.0:1788873708.367423:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:9979:x1875769859032320:12345-0@lo:502: Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.367430:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788873708.367476:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032192 00000100:00100000:0.0:1788873708.367480:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032192 00000100:00100000:0.0:1788873708.367497:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788873708.367501:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3632:x1875769859032192:12345-0@lo:8: 00010000:00080000:0.0:1788873708.367525:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788873708.367554:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9b5a5 00002000:00100000:0.0:1788873708.367567:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d3343979000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788873708.367571:0:8424:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788873708.367574:0:8424:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788873708.367654:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788873708.367699:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9d334397e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788873708.367844:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:9979:1875769859032320:0@lo:502: 00000020:01000000:1.0:1788873708.367873:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873708.367878:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873708.367881:0:9979:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788873708.367885:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1788873708.374511:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875769859032192:12345-0@lo:8: Request processed in 6998us (9877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.374527:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:0.0:1788873708.374577:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788873708.374615:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788873708.374630:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.374650:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873708.374661:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788873708.374664:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3480da19c0 from 1 10000000:01000000:0.0:1788873708.374667:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788873708.375801:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.375816:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873708.375838:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873708.375866:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859032448:0@lo:101: 00000100:00100000:0.0:1788873708.375940:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.375990:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.377675:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032448 00000100:00100000:2.0:1788873708.377696:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032448 00000100:00100000:2.0:1788873708.378024:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788873708.378035:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859032448:12345-0@lo:101: 00010000:00010000:2.0:1788873708.378054:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873708.378073:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b5ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.378115:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.378129:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873708.378138:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e200, rc 0) 00000100:00100000:2.0:1788873708.378366:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859032448:12345-0@lo:101: Request processed in 333us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.378373:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788873708.380899:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859032448:0@lo:101: 00000001:00100000:0.0:1788873708.381042:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788873708.381053:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1788873708.381068:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.381082:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873708.381308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9977:x1875769859030912:12345-0@lo:700: Request processed in 44736us (44882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.381320:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873708.381680:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859032576:0@lo:501: 00000100:00100000:1.0:1788873708.381722:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788873708.381851:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8e00 x1875769859030912/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873708.381882:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859030912:0@lo:700: 00000100:00100000:1.0:1788873708.382075:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab0c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788873708.385005:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a5500 x1875769859032192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873708.385020:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873708.385032:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788873708.385042:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788873708.385050:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788873708.385054:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d347a615000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788873708.385075:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788873708.385083:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859032192:0@lo:8: 00000004:00080000:3.0:1788873708.385127:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788873708.386352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032576 00000100:00100000:2.0:1788873708.386364:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032576 00000100:00100000:2.0:1788873708.386423:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788873708.386434:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859032576:12345-0@lo:501: 00000100:00100000:2.0:1788873708.386636:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859032576:12345-0@lo:501: Request processed in 204us (4913us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873708.386656:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788873708.386700:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859032576:0@lo:501: 10000000:01000000:1.0:1788873708.386759:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788873708.386769:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873708.386779:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788873708.391695:0:9977:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788873708.391729:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859032832:0@lo:7: 00000100:00100000:0.0:1788873708.391869:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.391898:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34517ca0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788873708.392437:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 245338231064ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788873708.392451:0:9980:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788873708.392741:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788873708.392761:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033088:0@lo:7: 00000100:00100000:1.0:1788873708.392804:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.392906:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.393139:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032832 00000100:00100000:3.0:1788873708.393149:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032832 00000100:00100000:3.0:1788873708.393229:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033088 00000100:00100000:3.0:1788873708.393233:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033088 00000100:00100000:3.0:1788873708.393267:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873708.393277:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1875769859032832:12345-0@lo:7: 00000100:00080000:1.0:1788873708.393768:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873708.395499:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859032960:0@lo:13: 00000100:00100000:0.0:1788873708.395541:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788873708.395562:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9981:x1875769859033088:12345-0@lo:7: 00000100:00100000:2.0:1788873708.395583:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.395631:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873708.395655:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859032704:0@lo:13: 00000100:00100000:2.0:1788873708.395685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.396055:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032960 00000100:00100000:1.0:1788873708.396064:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032960 00000100:00100000:1.0:1788873708.396097:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859032704 00000100:00100000:1.0:1788873708.396100:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859032704 00000100:00100000:1.0:1788873708.396114:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873708.396120:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859032960:12345-0@lo:13: 00002000:00000024:1.0:1788873708.396140:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:1.0:1788873708.396187:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859032960:12345-0@lo:13: Request processed in 67us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.396193:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873708.396225:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788873708.396231:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1875769859032704:12345-0@lo:13: 00002000:00000024:1.0:1788873708.396240:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:1.0:1788873708.396260:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1875769859032704:12345-0@lo:13: Request processed in 30us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873708.396265:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788873708.396347:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435a2300 x1875769859032704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.396369:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859032704:0@lo:13: 00010000:00080000:2.0:1788873708.396381:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a5f80 x1875769859032960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873708.396394:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859032960:0@lo:13: 00000004:00080000:0.0:1788873708.399059:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788873708.411630:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788873708.411650:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788873708.412356:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1875769859032832:12345-0@lo:7: Request processed in 19075us (20481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.412370:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788873708.413001:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435a2680 x1875769859032832/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873708.413019:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859032832:0@lo:7: 00000004:00080000:1.0:1788873708.413036:0:9977:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788873708.413084:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859033216:0@lo:5: 00000100:00100000:1.0:1788873708.413138:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.413176:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.413254:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033216 00000100:00100000:2.0:1788873708.413261:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033216 00000100:00100000:2.0:1788873708.413317:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788873708.413328:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9977:x1875769859033216:12345-0@lo:5: 00002000:00080000:2.0:1788873708.413354:0:8424:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788873708.413393:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9977:x1875769859033216:12345-0@lo:5: Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.413423:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788873708.413552:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a5f80 x1875769859033216/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873708.413574:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859033216:0@lo:5: 00000004:00080000:1.0:1788873708.413584:0:9977:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788873708.413609:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859033344:0@lo:5: 00000100:00100000:1.0:1788873708.413633:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.413664:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.413915:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033344 00000100:00100000:2.0:1788873708.413920:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033344 00000100:00100000:2.0:1788873708.413955:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873708.413964:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1875769859033344:12345-0@lo:5: 00002000:00080000:2.0:1788873708.413992:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00002000:00080000:0.0:1788873708.418019:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788873708.418029:0:8425:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788873708.418536:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9981:x1875769859033088:12345-0@lo:7: Request processed in 22981us (25727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873708.418546:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788873708.418689:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a4a80 x1875769859033088/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873708.418709:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033088:0@lo:7: 00000004:00080000:1.0:1788873708.418728:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788873708.418770:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033472:0@lo:5: 00000100:00100000:1.0:1788873708.418807:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.418827:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873708.418960:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033472 00000100:00100000:3.0:1788873708.418969:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033472 00000100:00100000:2.0:1788873708.418991:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9977:x1875769859033344:12345-0@lo:5: Request processed in 5026us (5354us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788873708.419001:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788873708.419025:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788873708.419037:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1875769859033472:12345-0@lo:5: 00002000:00080000:3.0:1788873708.419061:0:8789:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788873708.419065:0:8789:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788873708.419423:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9981:x1875769859033472:12345-0@lo:5: Request processed in 388us (615us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788873708.419431:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788873708.419533:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a1880 x1875769859033472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873708.419544:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033472:0@lo:5: 00000004:00080000:0.0:1788873708.419553:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788873708.419582:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033600:0@lo:700: 00000100:00100000:0.0:1788873708.419613:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.419636:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33428470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.419681:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033600 00000100:00100000:2.0:1788873708.419685:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033600 00000100:00100000:2.0:1788873708.419734:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873708.419742:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9981:x1875769859033600:12345-0@lo:700: 00010000:00080000:1.0:1788873708.420940:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a5f80 x1875769859033344/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873708.421447:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1875769859033344:0@lo:5: 00000004:00080000:1.0:1788873708.421467:0:9977:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788873708.421513:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1875769859033728:0@lo:900: 00000100:00100000:1.0:1788873708.421587:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873708.422665:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.423318:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033728 00000100:00100000:2.0:1788873708.423327:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033728 00000100:00100000:2.0:1788873708.423422:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873708.423432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1875769859033728:12345-0@lo:900: 00000001:00080000:1.0:1788873708.423482:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1788873708.423492:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788873708.423526:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1875769859033728:12345-0@lo:900: Request processed in 95us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.423534:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873708.423668:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9981:x1875769859033600:12345-0@lo:700: Request processed in 3926us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873708.423686:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788873708.423717:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435a1500 x1875769859033600/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788873708.423739:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a0e00 x1875769859033728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873708.423766:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1875769859033728:0@lo:900: 00000100:00100000:0.0:1788873708.423797:0:9981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788873708.423811:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033600:0@lo:700: 00000004:02000040:0.0:1788873708.425323:0:9981:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788873708.430315:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033856:0@lo:5: 00000100:00100000:0.0:1788873708.430403:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873708.430468:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33428470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873708.431012:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033856 00000100:00100000:2.0:1788873708.431021:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033856 00000100:00100000:2.0:1788873708.431074:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788873708.431084:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9981:x1875769859033856:12345-0@lo:5: 00002000:00080000:0.0:1788873708.446452:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788873708.446477:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788873708.448034:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9981:x1875769859033856:12345-0@lo:5: Request processed in 16943us (17622us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788873708.448047:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788873708.448386:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435a1500 x1875769859033856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788873724 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873708.448420:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1875769859033856:0@lo:5: 00000004:00080000:1.0:1788873708.448449:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788873708.654448:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873708.783440:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859033984:0@lo:41: 00000100:00100000:0.0:1788873708.783517:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873708.783652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859033984 00000100:00100000:2.0:1788873708.783660:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859033984 00000100:00100000:2.0:1788873708.783716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788873708.783726:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859033984:12345-0@lo:41: 00000004:00000024:2.0:1788873708.783763:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788873708.783821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859033984:12345-0@lo:41: Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873708.783827:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788873708.783932:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859033984:0@lo:41: 00000001:00080000:0.0:1788873709.129441:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1788873709.678540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788873710.358415:0:10032:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873710.359027:0:10032:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788873710.703294:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873711.348585:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859034112:0@lo:41: 00000100:00100000:2.0:1788873711.348700:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873711.348801:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034112 00000100:00100000:2.0:1788873711.348813:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034112 00000100:00100000:2.0:1788873711.348875:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788873711.348886:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859034112:12345-0@lo:41: 00000004:00000024:2.0:1788873711.348930:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788873711.349001:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859034112:12345-0@lo:41: Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873711.349009:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788873711.349078:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859034112:0@lo:41: 00000020:00000004:3.0:1788873711.586717:0:10080:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873711.586729:0:10080:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788873711.730440:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873712.133130:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873712.133503:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840107648 00000100:00100000:2.0:1788873712.133514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840107648 00000100:00100000:2.0:1788873712.133579:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 181 00000100:00100000:2.0:1788873712.133589:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875769840107648:12345-192.168.202.20@tcp:250: 00010000:00080000:2.0:1788873712.133630:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d31a6f3e-d81f-4ffc-812e-5eb0a6f00513@192.168.202.20@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1788873712.133659:0:6505:0:(genops.c:1385:class_connect()) connect: client d31a6f3e-d81f-4ffc-812e-5eb0a6f00513, cookie 0x25c660afb0a9b5ba 00000100:00080000:2.0:1788873712.133831:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9d33438f7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873712.133905:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+5:2397:x1875769840107648:12345-192.168.202.20@tcp:250: Request processed in 316us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873712.133913:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 181 00000100:00100000:2.0:1788873712.146413:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873712.150070:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840107776 00000100:00100000:0.0:1788873712.150088:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840107776 00000100:00100000:0.0:1788873712.150185:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 182 00000100:00100000:0.0:1788873712.150196:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+5:6161:x1875769840107776:12345-192.168.202.20@tcp:101: 00010000:00010000:0.0:1788873712.150229:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873712.150248:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a948b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873712.150633:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 6 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873712.150649:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 6 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873712.150679:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92c00, rc 0) 00000100:00100000:0.0:1788873712.150758:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+6:6161:x1875769840107776:12345-192.168.202.20@tcp:101: Request processed in 564us (4355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873712.150766:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 182 00000100:00100000:2.0:1788873712.155200:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873712.156507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840107904 00000100:00100000:1.0:1788873712.156521:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840107904 00000100:00100000:1.0:1788873712.156591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 183 00000100:00100000:1.0:1788873712.156610:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+6:6161:x1875769840107904:12345-192.168.202.20@tcp:501: 00000100:00100000:1.0:1788873712.156758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+6:6161:x1875769840107904:12345-192.168.202.20@tcp:501: Request processed in 157us (1568us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788873712.156766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 183 00000100:00100000:3.0:1788873712.171488:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873712.173830:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108032 00000100:00100000:0.0:1788873712.173845:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108032 00000100:00100000:0.0:1788873712.173910:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 184 00000100:00100000:0.0:1788873712.173917:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+6:6161:x1875769840108032:12345-192.168.202.20@tcp:101: 00010000:00010000:0.0:1788873712.173931:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873712.173947:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9492 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873712.173976:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 7 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873712.173988:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 7 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873712.173997:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93400, rc 0) 00000100:00100000:0.0:1788873712.174058:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+7:6161:x1875769840108032:12345-192.168.202.20@tcp:101: Request processed in 140us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873712.174062:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 184 00000100:00100000:0.0:1788873712.178587:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873712.178806:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108160 00000100:00100000:3.0:1788873712.178816:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108160 00000100:00100000:3.0:1788873712.178871:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 185 00000100:00100000:3.0:1788873712.178878:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+7:6161:x1875769840108160:12345-192.168.202.20@tcp:501: 00000100:00100000:3.0:1788873712.179037:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6161:x1875769840108160:12345-192.168.202.20@tcp:501: Request processed in 159us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873712.179043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 185 00000100:00100000:2.0:1788873712.182906:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873712.183086:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108288 00000100:00100000:1.0:1788873712.183096:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108288 00000100:00100000:1.0:1788873712.183165:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 186 00000100:00100000:1.0:1788873712.183175:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6161:x1875769840108288:12345-192.168.202.20@tcp:503: 00000100:00100000:1.0:1788873712.183351:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6161:x1875769840108288:12345-192.168.202.20@tcp:503: Request processed in 176us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873712.183358:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 186 00000100:00100000:1.0:1788873712.199006:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873712.199486:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108416 00000100:00100000:0.0:1788873712.199498:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108416 00000100:00100000:0.0:1788873712.199558:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 187 00000100:00100000:0.0:1788873712.199568:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6180:x1875769840108416:12345-192.168.202.20@tcp:502: 00000100:00100000:0.0:1788873712.199759:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6180:x1875769840108416:12345-192.168.202.20@tcp:502: Request processed in 191us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873712.199767:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 187 00000100:00100000:0.0:1788873712.248334:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873712.248425:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108544 00000100:00100000:3.0:1788873712.248436:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108544 00000100:00100000:3.0:1788873712.248490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 188 00000100:00100000:3.0:1788873712.248500:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6180:x1875769840108544:12345-192.168.202.20@tcp:502: 00000100:00100000:3.0:1788873712.248673:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6180:x1875769840108544:12345-192.168.202.20@tcp:502: Request processed in 173us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873712.248680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 188 00000100:00100000:2.0:1788873712.259713:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873712.260301:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108672 00000100:00100000:1.0:1788873712.260316:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108672 00000100:00100000:1.0:1788873712.260402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 189 00000100:00100000:1.0:1788873712.260416:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6161:x1875769840108672:12345-192.168.202.20@tcp:101: 00010000:00010000:1.0:1788873712.260463:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873712.260491:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfeb200/0x25c660afb0a9b5cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a94c3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873712.260530:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeb200/0x25c660afb0a9b5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94c3 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873712.260542:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfeb200/0x25c660afb0a9b5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94c3 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873712.260554:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeb200, rc 0) 00000100:00100000:1.0:1788873712.260652:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6161:x1875769840108672:12345-192.168.202.20@tcp:101: Request processed in 239us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873712.260659:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 189 00000100:00100000:1.0:1788873712.272577:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873712.272714:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108800 00000100:00100000:0.0:1788873712.272731:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108800 00000100:00100000:0.0:1788873712.272814:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 190 00000100:00100000:0.0:1788873712.272825:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6161:x1875769840108800:12345-192.168.202.20@tcp:256: 20000000:01000000:0.0:1788873712.272851:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788873712.272875:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788873712.272879:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788873712.272882:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788873712.272886:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788873712.272888:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788873712.278917:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6161:x1875769840108800:12345-192.168.202.20@tcp:256: Request processed in 6079us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873712.278935:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 190 00000100:00100000:2.0:1788873712.287251:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873712.287450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840108928 00000100:00100000:3.0:1788873712.287464:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840108928 00000100:00100000:3.0:1788873712.288190:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 191 00000100:00100000:3.0:1788873712.288258:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6161:x1875769840108928:12345-192.168.202.20@tcp:101: 00010000:00010000:3.0:1788873712.288293:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873712.288321:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a94ca expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873712.288388:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873712.288401:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873712.288414:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873712.288498:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6161:x1875769840108928:12345-192.168.202.20@tcp:101: Request processed in 296us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873712.288506:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 191 00000100:00100000:1.0:1788873712.292747:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873712.292944:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109056 00000100:00100000:2.0:1788873712.292958:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109056 00000100:00100000:2.0:1788873712.293045:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 192 00000100:00100000:2.0:1788873712.293057:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6161:x1875769840109056:12345-192.168.202.20@tcp:501: 00000100:00100000:2.0:1788873712.293597:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6161:x1875769840109056:12345-192.168.202.20@tcp:501: Request processed in 539us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873712.293618:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 192 00000100:00100000:0.0:1788873712.297651:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873712.298408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109184 00000100:00100000:3.0:1788873712.298427:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109184 00000100:00100000:3.0:1788873712.298516:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 193 00000100:00100000:3.0:1788873712.298529:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6161:x1875769840109184:12345-192.168.202.20@tcp:503: 00000100:00100000:3.0:1788873712.298826:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6161:x1875769840109184:12345-192.168.202.20@tcp:503: Request processed in 296us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873712.298835:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 193 00000100:00100000:3.0:1788873712.303266:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873712.303855:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109312 00000100:00100000:2.0:1788873712.303873:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109312 00000100:00100000:2.0:1788873712.303966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 194 00000100:00100000:2.0:1788873712.303982:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6182:x1875769840109312:12345-192.168.202.20@tcp:502: 00000100:00100000:2.0:1788873712.304392:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6182:x1875769840109312:12345-192.168.202.20@tcp:502: Request processed in 413us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873712.304403:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 194 00000100:00100000:2.0:1788873712.311134:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873712.311651:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109440 00000100:00100000:1.0:1788873712.311664:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109440 00000100:00100000:1.0:1788873712.311731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 195 00000100:00100000:1.0:1788873712.311742:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6182:x1875769840109440:12345-192.168.202.20@tcp:502: 00000100:00100000:1.0:1788873712.311901:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6182:x1875769840109440:12345-192.168.202.20@tcp:502: Request processed in 160us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873712.311910:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 195 00000100:00100000:0.0:1788873712.315931:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873712.316035:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873712.323125:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109568 00000100:00100000:2.0:1788873712.323159:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109568 00000100:00100000:2.0:1788873712.323227:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109824 00000100:00100000:2.0:1788873712.323244:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109824 00000100:00100000:2.0:1788873712.323277:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:2.0:1788873712.323287:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1875769840109568:12345-192.168.202.20@tcp:38: 00010000:00080000:2.0:1788873712.323318:0:8993:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1788873712.323371:0:8993:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9b5dd 00000004:00100000:2.0:1788873712.323399:0:8993:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788873712.323680:0:8993:0:(import.c:65:import_set_state_nolock()) ffff9d33438f4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873712.323761:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840109568:12345-192.168.202.20@tcp:38: Request processed in 474us (7841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873712.323769:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:2.0:1788873712.323798:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:2.0:1788873712.323803:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1875769840109824:12345-192.168.202.20@tcp:38: 00010000:00080000:2.0:1788873712.323839:0:8993:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1788873712.323881:0:8993:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9b5e4 00000004:00100000:2.0:1788873712.323894:0:8993:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788873712.327762:0:8993:0:(import.c:65:import_set_state_nolock()) ffff9d33438f4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873712.327840:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840109824:12345-192.168.202.20@tcp:38: Request processed in 4032us (11802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873712.327852:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 8 00010000:00010000:2.0:1788873712.750727:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873712.878729:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873712.878759:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859034240:0@lo:13: 00000100:00100000:2.0:1788873712.878869:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873712.879368:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034240 00000100:00100000:1.0:1788873712.879379:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034240 00000100:00100000:1.0:1788873712.879476:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873712.879489:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859034240:12345-0@lo:13: 00002000:00000024:1.0:1788873712.879535:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873712.879610:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859034240:12345-0@lo:13: Request processed in 109us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873712.879617:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788873712.879663:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334359f100 x1875769859034240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873712.879683:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859034240:0@lo:13: 00000100:00080000:0.0:1788873712.879870:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873712.880098:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873712.880111:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859034368:0@lo:13: 00000100:00100000:2.0:1788873712.880166:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873712.880309:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034368 00000100:00100000:3.0:1788873712.880315:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034368 00000100:00100000:3.0:1788873712.880363:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873712.880371:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859034368:12345-0@lo:13: 00002000:00000024:3.0:1788873712.880396:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873712.880453:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859034368:12345-0@lo:13: Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873712.880459:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788873712.880501:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8e00 x1875769859034368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873712.880514:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859034368:0@lo:13: 00000100:00080000:0.0:1788873712.880690:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873713.349459:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873713.349499:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873713.349531:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873713.349745:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110080 00000100:00100000:1.0:1788873713.349758:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110080 00000100:00100000:1.0:1788873713.349827:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109952 00000100:00100000:1.0:1788873713.349831:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109952 00000100:00100000:1.0:1788873713.349853:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840109696 00000100:00100000:1.0:1788873713.349856:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840109696 00000100:00100000:1.0:1788873713.349872:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788873713.349882:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:6161:x1875769840110080:12345-192.168.202.20@tcp:41: 00000004:00000024:1.0:1788873713.349936:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788873713.350006:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:6161:x1875769840110080:12345-192.168.202.20@tcp:41: Request processed in 124us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.350014:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788873713.350031:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:1.0:1788873713.350039:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840109952:12345-192.168.202.20@tcp:41: 00000004:00000024:1.0:1788873713.350068:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873713.350094:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840109952:12345-192.168.202.20@tcp:41: Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.350101:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:1.0:1788873713.350113:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:1.0:1788873713.350151:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840109696:12345-192.168.202.20@tcp:41: 00000004:00000024:1.0:1788873713.350162:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788873713.350184:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840109696:12345-192.168.202.20@tcp:41: Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.350190:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00080000:2.0:1788873713.351983:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873713.351993:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873713.356850:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873713.362055:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110208 00000100:00100000:1.0:1788873713.362070:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110208 00000100:00100000:1.0:1788873713.362159:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:1.0:1788873713.362170:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6161:x1875769840110208:12345-192.168.202.20@tcp:40: 00000100:00100000:1.0:1788873713.362315:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6161:x1875769840110208:12345-192.168.202.20@tcp:40: Request processed in 146us (5476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.362324:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:0.0:1788873713.365245:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873713.366985:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873713.367016:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873713.367090:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873713.367148:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110720 00000100:00100000:0.0:1788873713.367157:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110720 00000100:00100000:0.0:1788873713.367233:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 196 00000100:00100000:0.0:1788873713.367245:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840110720:12345-192.168.202.20@tcp:400: 00000100:00100000:0.0:1788873713.367326:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840110720:12345-192.168.202.20@tcp:400: Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.367334:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 196 00000100:00100000:1.0:1788873713.367464:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110336 00000100:00100000:1.0:1788873713.367470:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110336 00000100:00100000:1.0:1788873713.367493:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110464 00000100:00100000:1.0:1788873713.367496:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110464 00000100:00100000:1.0:1788873713.367511:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:1.0:1788873713.367517:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875769840110336:12345-192.168.202.20@tcp:8: 00010000:00080000:1.0:1788873713.367545:0:8789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 250 last 0 00000100:00100000:0.0:1788873713.367560:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:0.0:1788873713.367567:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875769840110464:12345-192.168.202.20@tcp:8: 00000020:00000080:1.0:1788873713.367577:0:8789:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9b5eb 00010000:00080000:0.0:1788873713.367588:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 250 last 0 00002000:00100000:1.0:1788873713.367604:0:8789:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64e5d878-4280-4742-8a19-a12ccf17cae7/ffff9d3341eaf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788873713.367618:0:8789:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:0.0:1788873713.367622:0:8425:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9b5f2 00002000:00100000:0.0:1788873713.367631:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64e5d878-4280-4742-8a19-a12ccf17cae7/ffff9d334397e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788873713.367762:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788873713.367864:0:8789:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788873713.367911:0:8789:0:(import.c:65:import_set_state_nolock()) ffff9d3341ead000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1788873713.367930:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788873713.367950:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840110336:12345-192.168.202.20@tcp:8: Request processed in 430us (973us total) trans 0 rc 0/0 00000100:00080000:0.0:1788873713.367951:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d334397c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788873713.367970:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:0.0:1788873713.367983:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840110464:12345-192.168.202.20@tcp:8: Request processed in 414us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.367992:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:2.0:1788873713.368929:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110592 00000100:00100000:2.0:1788873713.368937:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110592 00000100:00100000:2.0:1788873713.368990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:2.0:1788873713.368999:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6161:x1875769840110592:12345-192.168.202.20@tcp:900: 00000100:00100000:2.0:1788873713.369278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6161:x1875769840110592:12345-192.168.202.20@tcp:900: Request processed in 269us (4065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873713.369286:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:0.0:1788873713.374039:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873713.374384:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110848 00000100:00100000:2.0:1788873713.374395:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110848 00000100:00100000:2.0:1788873713.374454:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:2.0:1788873713.374466:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6161:x1875769840110848:12345-192.168.202.20@tcp:33: 00000100:00100000:0.0:1788873713.390672:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859034752:0@lo:400: 00000100:00100000:0.0:1788873713.390743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873713.390801:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859035264:0@lo:400: 00000100:00100000:0.0:1788873713.390826:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873713.390849:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859035776:0@lo:400: 00000100:00100000:0.0:1788873713.390870:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873713.390894:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788873713.390900:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859034880:0@lo:400: 00000100:00100000:0.0:1788873713.390920:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873713.390947:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859035392:0@lo:400: 00000100:00100000:0.0:1788873713.390973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873713.390992:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859035904:0@lo:400: 00000100:00100000:0.0:1788873713.391010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873713.391427:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034752 00000100:00100000:0.0:1788873713.391436:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034752 00000100:00100000:0.0:1788873713.391480:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788873713.391489:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859034752:12345-0@lo:400: 00000100:00100000:0.0:1788873713.391544:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859034752:12345-0@lo:400: Request processed in 56us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.391551:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788873713.391574:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035264 00000100:00100000:0.0:1788873713.391577:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035264 00000100:00100000:0.0:1788873713.391621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035776 00000100:00100000:0.0:1788873713.391625:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035776 00000100:00100000:2.0:1788873713.391774:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859034496:0@lo:400: 00000100:00100000:2.0:1788873713.391811:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.391838:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859035008:0@lo:400: 00000100:00100000:2.0:1788873713.391861:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.391878:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859035520:0@lo:400: 00000100:00100000:2.0:1788873713.392192:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.392236:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859036032:0@lo:400: 00000100:00100000:2.0:1788873713.392258:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.392620:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788873713.392627:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859034624:0@lo:400: 00000100:00100000:1.0:1788873713.392787:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035392 00000100:00100000:1.0:1788873713.392792:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035392 00000100:00100000:1.0:1788873713.392819:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035904 00000100:00100000:1.0:1788873713.392822:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035904 00000100:00100000:1.0:1788873713.392836:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035520 00000100:00100000:1.0:1788873713.392838:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035520 00000100:00100000:1.0:1788873713.392849:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036032 00000100:00100000:1.0:1788873713.392851:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036032 00000100:00100000:1.0:1788873713.392865:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788873713.392874:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859035392:12345-0@lo:400: 00000100:00100000:1.0:1788873713.392914:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859035392:12345-0@lo:400: Request processed in 42us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.392921:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788873713.392934:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873713.392941:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859035904:12345-0@lo:400: 00000100:00100000:1.0:1788873713.392968:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859035904:12345-0@lo:400: Request processed in 28us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.392973:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873713.392983:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788873713.392989:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859035520:12345-0@lo:400: 00000100:00100000:1.0:1788873713.393013:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859035520:12345-0@lo:400: Request processed in 25us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.393019:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873713.393232:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.393255:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859035136:0@lo:400: 00000100:00100000:1.0:1788873713.393370:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873713.393377:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859036032:12345-0@lo:400: 00000100:00100000:1.0:1788873713.393406:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859036032:12345-0@lo:400: Request processed in 30us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.393424:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873713.393452:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034880 00000100:00100000:1.0:1788873713.393456:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034880 00000100:00100000:1.0:1788873713.393472:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034624 00000100:00100000:1.0:1788873713.393475:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034624 00000100:00100000:1.0:1788873713.393487:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788873713.393494:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859035264:12345-0@lo:400: 00000100:00100000:1.0:1788873713.393526:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859035264:12345-0@lo:400: Request processed in 32us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.393531:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788873713.393543:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788873713.393549:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859034880:12345-0@lo:400: 00000100:00100000:1.0:1788873713.393574:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859034880:12345-0@lo:400: Request processed in 26us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.393580:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788873713.393602:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788873713.393609:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859034624:12345-0@lo:400: 00000100:00100000:1.0:1788873713.393634:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859034624:12345-0@lo:400: Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.393787:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788873713.393796:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859035776:12345-0@lo:400: 00000100:00100000:0.0:1788873713.393827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859035776:12345-0@lo:400: Request processed in 33us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.393832:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788873713.393870:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1c700 x1875769859034880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873713.393883:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859034880:0@lo:400: 00010000:00080000:0.0:1788873713.393893:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1d180 x1875769859035392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873713.393901:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859035392:0@lo:400: 00010000:00080000:0.0:1788873713.393921:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1ca80 x1875769859035904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873713.393928:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788873713.393942:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859035904:0@lo:400: 00000100:00100000:0.0:1788873713.393954:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859034752:0@lo:400: 00010000:00080000:0.0:1788873713.393962:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1f800 x1875769859035264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873713.393969:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859035264:0@lo:400: 00010000:00080000:0.0:1788873713.393978:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1fb80 x1875769859035776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873713.393985:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859035776:0@lo:400: 00000100:00100000:2.0:1788873713.394249:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.394430:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859035648:0@lo:400: 00000100:00100000:2.0:1788873713.394456:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788873713.394483:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1ea00 x1875769859035520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873713.394491:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859035520:0@lo:400: 00010000:00080000:2.0:1788873713.394499:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1e300 x1875769859036032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873713.394505:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788873713.394514:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859036032:0@lo:400: 00010000:00080000:2.0:1788873713.394526:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435a0700 x1875769859034624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873713.394533:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859034624:0@lo:400: 00000100:00100000:2.0:1788873713.394554:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035136 00000100:00100000:2.0:1788873713.394557:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035136 00000100:00100000:2.0:1788873713.394578:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035648 00000100:00100000:2.0:1788873713.394580:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035648 00000100:00100000:2.0:1788873713.394611:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788873713.394625:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859035136:12345-0@lo:400: 00000100:00100000:1.0:1788873713.396236:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788873713.397256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859035008 00000100:00100000:1.0:1788873713.397363:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788873713.397385:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859035648:12345-0@lo:400: 00000100:00100000:1.0:1788873713.397483:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859035648:12345-0@lo:400: Request processed in 110us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.397491:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788873713.397544:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873713.397560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873713.397563:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873713.398154:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859035136:12345-0@lo:400: Request processed in 3527us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873713.398164:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788873713.398227:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1c000 x1875769859035136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873713.398241:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859035136:0@lo:400: 00010000:00080000:2.0:1788873713.398252:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1dc00 x1875769859035648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873713.398261:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859035648:0@lo:400: 00000100:00100000:2.0:1788873713.398313:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859034496 00000100:00100000:2.0:1788873713.398318:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859034496 00000100:00100000:2.0:1788873713.398351:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788873713.398357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859034496:12345-0@lo:400: 00000100:00100000:2.0:1788873713.398391:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859034496:12345-0@lo:400: Request processed in 34us (6580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873713.398397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788873713.398430:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859034496:0@lo:400: 00000100:00100000:0.0:1788873713.398493:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859035008 00000100:00100000:0.0:1788873713.398528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788873713.398534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859035008:12345-0@lo:400: 00000100:00100000:0.0:1788873713.398572:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859035008:12345-0@lo:400: Request processed in 38us (6710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.398577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788873713.399949:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859035008:0@lo:400: 00000004:00080000:0.0:1788873713.406149:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31594us 00000004:00200000:0.0:1788873713.423300:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788873713.423409:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6161:x1875769840110848:12345-192.168.202.20@tcp:33: Request processed in 48939us (49388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.423424:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:0.0:1788873713.740359:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873713.748360:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840110976 00000100:00100000:1.0:1788873713.748381:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840110976 00000100:00100000:1.0:1788873713.748560:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:1.0:1788873713.748573:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6200:x1875769840110976:12345-192.168.202.20@tcp:101: 00010000:00010000:1.0:1788873713.748614:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873713.749824:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfebe00/0x25c660afb0a9b5f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a94fb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873713.749913:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfeb000/0x25c660afb0a9b600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873713.749931:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfeb000/0x25c660afb0a9b600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873713.749949:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfeb000/0x25c660afb0a9b600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873713.750004:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788873713.750008:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873713.750026:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfeb000/0x25c660afb0a9b600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873713.750479:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfebe00/0x25c660afb0a9b5f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94fb expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873713.750515:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfeb000/0x25c660afb0a9b600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94fb expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873713.750524:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd500) 00010000:00010000:1.0:1788873713.750548:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873713.750552:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeb000, rc 0) 00000100:00100000:0.0:1788873713.753983:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:6200:x1875769840110976:12345-192.168.202.20@tcp:101: Request processed in 5400us (13622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873713.753998:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 13 00010000:00010000:1.0:1788873713.774396:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873713.903178:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859036160:0@lo:13: 00000100:00100000:1.0:1788873713.903290:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873713.903728:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873713.903740:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859036288:0@lo:41: 00000100:00100000:2.0:1788873713.903773:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873713.904618:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036288 00000100:00100000:1.0:1788873713.904627:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036288 00000100:00100000:1.0:1788873713.904682:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788873713.904693:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859036288:12345-0@lo:41: 00000004:00000024:1.0:1788873713.904721:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873713.904752:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036160 00000100:00100000:3.0:1788873713.904758:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036160 00000100:00100000:1.0:1788873713.904779:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859036288:12345-0@lo:41: Request processed in 86us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873713.904788:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788873713.904794:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873713.904804:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859036160:12345-0@lo:13: 00000100:00100000:1.0:1788873713.904810:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:3.0:1788873713.904820:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873713.904824:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859036416:0@lo:13: 00000100:00100000:1.0:1788873713.904865:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873713.904886:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859036160:12345-0@lo:13: Request processed in 82us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873713.904894:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873713.904912:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036416 00000100:00100000:3.0:1788873713.904916:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036416 00000100:00100000:3.0:1788873713.904935:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873713.904943:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859036416:12345-0@lo:13: 00010000:00080000:1.0:1788873713.904946:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a5f80 x1875769859036160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788873713.904955:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873713.904967:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859036160:0@lo:13: 00000100:00100000:3.0:1788873713.904994:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859036416:12345-0@lo:13: Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873713.905002:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788873713.905016:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8e00 x1875769859036416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873713.905050:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859036416:0@lo:13: 00000100:00100000:2.0:1788873713.905339:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859036288:0@lo:41: 00010000:00010000:2.0:1788873714.798497:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873715.822464:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873715.853731:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873715.858919:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111104 00000100:00100000:2.0:1788873715.858934:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111104 00000100:00100000:2.0:1788873715.859038:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:2.0:1788873715.859052:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:6252:x1875769840111104:12345-192.168.202.20@tcp:41: 00000004:00000024:2.0:1788873715.859094:0:8450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788873715.859182:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:6252:x1875769840111104:12345-192.168.202.20@tcp:41: Request processed in 135us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873715.859190:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00080000:1.0:1788873715.859245:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873715.863664:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873715.863821:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111232 00000100:00100000:2.0:1788873715.863835:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111232 00000100:00100000:2.0:1788873715.863970:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:2.0:1788873715.863986:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6252:x1875769840111232:12345-192.168.202.20@tcp:41: 00000100:00080000:1.0:1788873715.863986:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1788873715.864046:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788873715.865296:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6252:x1875769840111232:12345-192.168.202.20@tcp:41: Request processed in 1304us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873715.865309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:0.0:1788873715.871281:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873715.871379:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111360 00000100:00100000:3.0:1788873715.871394:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111360 00000100:00100000:3.0:1788873715.871488:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:3.0:1788873715.871501:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6252:x1875769840111360:12345-192.168.202.20@tcp:13: 00002000:00000024:3.0:1788873715.871549:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873715.871647:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6252:x1875769840111360:12345-192.168.202.20@tcp:13: Request processed in 149us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873715.871673:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00080000:1.0:1788873715.871748:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873715.875132:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873715.875386:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111488 00000100:00100000:3.0:1788873715.875398:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111488 00000100:00100000:3.0:1788873715.875487:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:3.0:1788873715.875500:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6252:x1875769840111488:12345-192.168.202.20@tcp:13: 00002000:00000024:3.0:1788873715.875546:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873715.875641:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64e5d878-4280-4742-8a19-a12ccf17cae7+6:6252:x1875769840111488:12345-192.168.202.20@tcp:13: Request processed in 143us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873715.875649:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00080000:1.0:1788873715.875785:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873716.462601:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859036544:0@lo:41: 00000100:00100000:3.0:1788873716.462713:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873716.462884:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036544 00000100:00100000:2.0:1788873716.462897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036544 00000100:00100000:2.0:1788873716.462970:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788873716.462984:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859036544:12345-0@lo:41: 00000004:00000024:2.0:1788873716.463035:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788873716.463115:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859036544:12345-0@lo:41: Request processed in 135us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873716.463124:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788873716.463404:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859036544:0@lo:41: 00010000:00010000:2.0:1788873716.847470:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788873716.979830:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00010000:00010000:1.0:1788873717.870370:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873718.004586:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859036672:0@lo:13: 00000100:00100000:1.0:1788873718.004676:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1788873718.005460:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000100:00100000:3.0:1788873718.005569:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036672 00000100:00100000:3.0:1788873718.005578:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036672 00000100:00100000:3.0:1788873718.005660:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873718.005671:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859036672:12345-0@lo:13: 00002000:00000024:3.0:1788873718.005701:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873718.005764:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859036672:12345-0@lo:13: Request processed in 95us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.005771:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788873718.006378:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873718.006394:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859036800:0@lo:13: 00000100:00100000:0.0:1788873718.006436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873718.006478:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036800 00000100:00100000:0.0:1788873718.006483:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036800 00000100:00100000:0.0:1788873718.006515:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788873718.006522:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859036800:12345-0@lo:13: 00002000:00000024:0.0:1788873718.006536:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873718.006576:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859036800:12345-0@lo:13: Request processed in 54us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873718.006583:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788873718.006745:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1d180 x1875769859036800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873718.006765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859036800:0@lo:13: 00000100:00080000:2.0:1788873718.007335:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873718.008028:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1ca80 x1875769859036672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873718.008050:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859036672:0@lo:13: 00000001:00100000:3.0:1788873718.010484:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000100:00100000:0.0:1788873718.421372:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873718.421447:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873718.421488:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873718.421507:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873718.421552:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873718.421617:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111872 00000100:00100000:0.0:1788873718.421628:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111872 00000100:00100000:0.0:1788873718.421688:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111744 00000100:00100000:2.0:1788873718.421695:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:0.0:1788873718.421704:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111744 00000100:00100000:2.0:1788873718.421708:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840111872:12345-192.168.202.20@tcp:400: 00000100:00100000:0.0:1788873718.421728:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:0.0:1788873718.421734:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840111744:12345-192.168.202.20@tcp:400: 00000100:00100000:2.0:1788873718.421785:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840111872:12345-192.168.202.20@tcp:400: Request processed in 80us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873718.421794:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:1.0:1788873718.421801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840111616 00000100:00100000:1.0:1788873718.421805:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840111616 00000100:00100000:1.0:1788873718.421833:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 198 00000100:00100000:1.0:1788873718.421840:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840111616:12345-192.168.202.20@tcp:400: 00000100:00080000:3.0:1788873718.422237:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873718.422242:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873718.422739:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840111744:12345-192.168.202.20@tcp:400: Request processed in 1002us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873718.422749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:0.0:1788873718.422793:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112128 00000100:00100000:0.0:1788873718.422799:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112128 00000100:00100000:0.0:1788873718.422845:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112000 00000100:00100000:0.0:1788873718.422848:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112000 00000100:00100000:0.0:1788873718.422869:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:0.0:1788873718.422875:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840112128:12345-192.168.202.20@tcp:400: 00000100:00100000:0.0:1788873718.422908:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840112128:12345-192.168.202.20@tcp:400: Request processed in 33us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873718.422914:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:0.0:1788873718.422926:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:0.0:1788873718.422931:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840112000:12345-192.168.202.20@tcp:400: 00000100:00100000:0.0:1788873718.422953:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840112000:12345-192.168.202.20@tcp:400: Request processed in 22us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873718.422958:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00080000:3.0:1788873718.424156:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788873718.424164:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873718.425184:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840111616:12345-192.168.202.20@tcp:400: Request processed in 3334us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873718.425197:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 198 00000100:00100000:3.0:1788873718.512672:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859037312:0@lo:400: 00000100:00100000:3.0:1788873718.512774:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.512854:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859037824:0@lo:400: 00000100:00100000:3.0:1788873718.512915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.512954:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788873718.512961:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859036928:0@lo:400: 00000100:00100000:3.0:1788873718.512997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513017:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859037440:0@lo:400: 00000100:00100000:3.0:1788873718.513039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513057:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859037952:0@lo:400: 00000100:00100000:3.0:1788873718.513080:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513115:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859037056:0@lo:400: 00000100:00100000:3.0:1788873718.513142:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513163:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859037568:0@lo:400: 00000100:00100000:3.0:1788873718.513184:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513201:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859038080:0@lo:400: 00000100:00100000:3.0:1788873718.513260:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513293:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788873718.513300:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859037184:0@lo:400: 00000100:00100000:3.0:1788873718.513322:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513335:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859037696:0@lo:400: 00000100:00100000:3.0:1788873718.513351:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513364:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859038208:0@lo:400: 00000100:00100000:3.0:1788873718.513381:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873718.513402:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037312 00000100:00100000:3.0:1788873718.513409:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037312 00000100:00100000:3.0:1788873718.513447:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037056 00000100:00100000:3.0:1788873718.513450:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037056 00000100:00100000:3.0:1788873718.513461:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037568 00000100:00100000:3.0:1788873718.513463:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037568 00000100:00100000:3.0:1788873718.513482:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038080 00000100:00100000:3.0:1788873718.513485:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038080 00000100:00100000:3.0:1788873718.513506:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037696 00000100:00100000:3.0:1788873718.513509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037696 00000100:00100000:3.0:1788873718.513521:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038208 00000100:00100000:3.0:1788873718.513523:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038208 00000100:00100000:3.0:1788873718.513535:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788873718.513567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859037312:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859037312:12345-0@lo:400: Request processed in 77us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513629:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788873718.513648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788873718.513655:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859037056:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513685:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859037056:12345-0@lo:400: Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513690:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788873718.513699:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788873718.513704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859037568:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513725:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859037568:12345-0@lo:400: Request processed in 21us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513729:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788873718.513738:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788873718.513744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859038080:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513764:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859038080:12345-0@lo:400: Request processed in 22us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788873718.513787:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788873718.513792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859037696:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513817:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859037696:12345-0@lo:400: Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788873718.513831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788873718.513836:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859038208:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513859:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859038208:12345-0@lo:400: Request processed in 23us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513863:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788873718.513883:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037824 00000100:00100000:3.0:1788873718.513887:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037824 00000100:00100000:3.0:1788873718.513908:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037952 00000100:00100000:3.0:1788873718.513910:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037952 00000100:00100000:3.0:1788873718.513925:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873718.513931:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859037824:12345-0@lo:400: 00000100:00100000:3.0:1788873718.513959:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859037824:12345-0@lo:400: Request processed in 28us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.513965:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873718.513975:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873718.513981:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859037952:12345-0@lo:400: 00000100:00100000:3.0:1788873718.514006:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859037952:12345-0@lo:400: Request processed in 26us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.514012:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873718.514028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037440 00000100:00100000:3.0:1788873718.514038:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037440 00000100:00100000:3.0:1788873718.514062:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859037184 00000100:00100000:3.0:1788873718.514065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859037184 00000100:00100000:3.0:1788873718.514079:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788873718.514084:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859037440:12345-0@lo:400: 00000100:00100000:3.0:1788873718.514116:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859037440:12345-0@lo:400: Request processed in 32us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.514122:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788873718.514133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788873718.514139:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859037184:12345-0@lo:400: 00000100:00100000:3.0:1788873718.514165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859037184:12345-0@lo:400: Request processed in 26us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873718.514170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788873718.514201:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873718.514229:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873718.514269:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859037184:0@lo:400: 00010000:00080000:3.0:1788873718.514283:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f356300 x1875769859037696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873718.514292:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859037696:0@lo:400: 00010000:00080000:3.0:1788873718.514301:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f354e00 x1875769859038208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873718.514308:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859038208:0@lo:400: 00000100:00100000:3.0:1788873718.514318:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859037056:0@lo:400: 00000100:00100000:3.0:1788873718.514327:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859037568:0@lo:400: 00000100:00100000:3.0:1788873718.514336:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859038080:0@lo:400: 00000100:00100000:3.0:1788873718.514383:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859037440:0@lo:400: 00010000:00080000:3.0:1788873718.514394:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f354380 x1875769859037952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873718.514401:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859037952:0@lo:400: 00000100:00100000:3.0:1788873718.514414:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859037312:0@lo:400: 00010000:00080000:3.0:1788873718.514422:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f356680 x1875769859037824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873718.514429:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859037824:0@lo:400: 00000100:00100000:1.0:1788873718.514595:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859036928 00000100:00100000:1.0:1788873718.514600:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859036928 00000100:00100000:1.0:1788873718.514641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788873718.514650:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859036928:12345-0@lo:400: 00000100:00100000:1.0:1788873718.514692:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859036928:12345-0@lo:400: Request processed in 44us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873718.514697:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788873718.514736:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859036928:0@lo:400: 00000100:00100000:0.0:1788873718.515093:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859038464:0@lo:400: 00000100:00100000:0.0:1788873718.515131:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873718.515162:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873718.515168:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859038336:0@lo:400: 00000100:00100000:0.0:1788873718.515187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873718.515326:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038464 00000100:00100000:1.0:1788873718.515331:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038464 00000100:00100000:1.0:1788873718.515368:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038336 00000100:00100000:1.0:1788873718.515371:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038336 00000100:00100000:1.0:1788873718.515389:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873718.515395:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859038464:12345-0@lo:400: 00000100:00100000:1.0:1788873718.515439:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859038464:12345-0@lo:400: Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873718.515446:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873718.515458:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788873718.515463:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859038336:12345-0@lo:400: 00000100:00100000:1.0:1788873718.515486:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859038336:12345-0@lo:400: Request processed in 23us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873718.515492:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788873718.515519:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355f80 x1875769859038336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873718.515530:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859038336:0@lo:400: 00010000:00080000:1.0:1788873718.515539:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a727100 x1875769859038464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873718.515561:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859038464:0@lo:400: 00000100:00080000:0.0:1788873718.515699:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788873718.895593:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873719.029679:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859038592:0@lo:41: 00000100:00100000:0.0:1788873719.029750:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873719.029830:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038592 00000100:00100000:0.0:1788873719.029838:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038592 00000100:00100000:0.0:1788873719.029887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788873719.029896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859038592:12345-0@lo:41: 00000004:00000024:0.0:1788873719.029930:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873719.030018:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859038592:12345-0@lo:41: Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873719.030025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788873719.030072:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859038592:0@lo:41: 00000001:02000400:3.0:1788873719.031307:0:10178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788873719.031798:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873719.031818:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859038720:0@lo:13: 00000100:00100000:0.0:1788873719.031888:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873719.031949:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859038848:0@lo:13: 00000100:00100000:0.0:1788873719.031976:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873719.032013:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038720 00000100:00100000:0.0:1788873719.032021:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038720 00000100:00100000:0.0:1788873719.032055:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038848 00000100:00100000:0.0:1788873719.032058:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038848 00000100:00100000:0.0:1788873719.032074:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788873719.032083:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859038720:12345-0@lo:13: 00002000:00000024:0.0:1788873719.032110:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873719.032152:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859038720:12345-0@lo:13: Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873719.032159:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788873719.032184:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788873719.032190:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859038848:12345-0@lo:13: 00002000:00000024:0.0:1788873719.032200:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873719.032250:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859038848:12345-0@lo:13: Request processed in 60us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873719.032256:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788873719.032294:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a727100 x1875769859038720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873719.032315:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859038720:0@lo:13: 00010000:00080000:0.0:1788873719.032343:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355880 x1875769859038848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873719.032355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859038848:0@lo:13: 00000001:00100000:1.0:1788873719.033985:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00010000:00010000:1.0:1788873719.919041:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873720.942575:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873721.585951:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859038976:0@lo:41: 00000100:00100000:2.0:1788873721.586018:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873721.586104:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859038976 00000100:00100000:2.0:1788873721.586112:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859038976 00000100:00100000:2.0:1788873721.586157:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788873721.586166:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859038976:12345-0@lo:41: 00000004:00000024:2.0:1788873721.586200:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788873721.586269:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859038976:12345-0@lo:41: Request processed in 103us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873721.586276:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788873721.586331:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859038976:0@lo:41: 00010000:00010000:2.0:1788873721.976018:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873722.991907:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873723.118538:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873723.118573:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859039104:0@lo:13: 00000100:00100000:0.0:1788873723.118652:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873723.118728:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859039104 00000100:00100000:0.0:1788873723.118736:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859039104 00000100:00100000:0.0:1788873723.118793:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788873723.118803:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859039104:12345-0@lo:13: 00002000:00000024:0.0:1788873723.118839:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873723.118886:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859039104:12345-0@lo:13: Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.118894:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788873723.118921:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788873723.118954:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355880 x1875769859039104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873723.119934:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859039104:0@lo:13: 00000100:00100000:1.0:1788873723.120378:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859039232:0@lo:13: 00000100:00100000:1.0:1788873723.120447:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873723.120560:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859039232 00000100:00100000:0.0:1788873723.120568:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859039232 00000100:00100000:0.0:1788873723.120625:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788873723.120633:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859039232:12345-0@lo:13: 00002000:00000024:0.0:1788873723.120652:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873723.120696:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859039232:12345-0@lo:13: Request processed in 63us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.120702:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788873723.120748:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355880 x1875769859039232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873723.120767:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859039232:0@lo:13: 00000100:00080000:1.0:1788873723.120825:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788873723.330885:0:10325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc77f04520 20000000:00000080:2.0:1788873723.330908:0:10325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347a6a4800 uarg=0000000000000000 20000000:01000000:2.0:1788873723.330967:0:10325:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788873723.330969:0:10325:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788873723.330972:0:10325:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788873723.330976:0:10325:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788873723.330981:0:10325:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788873723.331046:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788873723.331054:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788873723.338054:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788873723.342288:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788873723.342326:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788873723.342342:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788873723.342353:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788873723.342355:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788873723.346244:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788873723.346765:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788873723.346799:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788873723.346815:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788873723.346833:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788873723.346836:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788873723.347326:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788873723.347510:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788873723.347540:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788873723.347553:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788873723.347563:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788873723.347565:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788873723.348032:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788873723.348161:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788873723.348181:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788873723.348195:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788873723.348235:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788873723.348238:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788873723.348601:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788873723.348856:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788873723.348873:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788873723.348884:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1788873723.348900:0:10325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788873723.348921:0:10325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348943:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348951:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348957:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348964:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348971:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348979:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348985:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348992:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.348999:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.349016:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.349022:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.349029:0:10325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.349073:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.349088:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 9 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.349103:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039360:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873723.350247:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350260:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 9 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.350272:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039488:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873723.350325:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350331:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 23 pid: 6503 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.350351:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039616:0@lo:104: 00000100:00100000:0.0:1788873723.350390:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873723.350432:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350438:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.350444:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039744:0@lo:104: 00000100:00100000:0.0:1788873723.350458:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873723.350472:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350477:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.350481:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039872:0@lo:104: 00000100:00100000:0.0:1788873723.350491:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873723.350514:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350523:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.350531:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040000:0@lo:104: 00000100:00100000:0.0:1788873723.350559:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873723.350592:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.350601:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788873723.350610:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.350615:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859039616 00000100:00100000:0.0:1788873723.350617:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040128:0@lo:104: 00000100:00100000:3.0:1788873723.350621:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859039616 00000100:00100000:0.0:1788873723.350636:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873723.350651:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350659:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.350662:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859039744 00000100:00100000:3.0:1788873723.350664:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859039744 00000100:00100000:0.0:1788873723.350666:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040256:0@lo:104: 00000100:00100000:3.0:1788873723.350674:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859039872 00000100:00100000:3.0:1788873723.350676:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859039872 00000100:00100000:3.0:1788873723.350685:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040000 00000100:00100000:3.0:1788873723.350688:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040000 00000100:00100000:0.0:1788873723.350693:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.350696:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040128 00000100:00100000:3.0:1788873723.350703:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040128 00010000:00010000:0.0:1788873723.350712:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350720:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.350727:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040256 00000100:00100000:0.0:1788873723.350727:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040384:0@lo:104: 00000100:00100000:3.0:1788873723.350730:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040256 00000100:00100000:3.0:1788873723.350743:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788873723.350752:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+8:10325:x1875769859039616:12345-0@lo:104: 00000100:00100000:0.0:1788873723.350756:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873723.350765:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350771:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.350778:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.350785:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040512:0@lo:104: 00000100:00100000:0.0:1788873723.350809:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873723.350813:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788873723.350819:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+8:10325:x1875769859039616:12345-0@lo:104: Request processed in 68us (428us total) trans 0 rc 0/0 00010000:00010000:0.0:1788873723.350824:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.350826:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788873723.350833:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 23 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.350840:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040384 00000100:00100000:0.0:1788873723.350840:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040640:0@lo:104: 00000100:00100000:3.0:1788873723.350843:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040384 00000100:00100000:3.0:1788873723.350852:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040512 00000100:00100000:3.0:1788873723.350855:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040512 00000100:00100000:0.0:1788873723.350858:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.350863:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040640 00000100:00100000:3.0:1788873723.350865:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040640 00000100:00100000:0.0:1788873723.350869:0:10325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf840 going to sleep for 11 seconds 00000100:00100000:3.0:1788873723.350874:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788873723.350879:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:10325:x1875769859039744:12345-0@lo:104: 00000100:00100000:0.0:1788873723.350887:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039616:0@lo:104: 00010000:00010000:3.0:1788873723.351074:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351141:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788873723.351146:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+10:10325:x1875769859039744:12345-0@lo:104: Request processed in 267us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.351152:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788873723.351166:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788873723.351172:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:10325:x1875769859039872:12345-0@lo:104: 00010000:00010000:1.0:1788873723.351176:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788873723.351183:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873723.351191:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873723.351195:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351198:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351250:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788873723.351255:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+9:10325:x1875769859039872:12345-0@lo:104: Request processed in 84us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.351256:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039744:0@lo:104: 00000100:00100000:3.0:1788873723.351262:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788873723.351263:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039872:0@lo:104: 00000100:00100000:3.0:1788873723.351274:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788873723.351280:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334275cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+8:10325:x1875769859040000:12345-0@lo:104: 00010000:00010000:3.0:1788873723.351288:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351324:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788873723.351329:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334275cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+8:10325:x1875769859040000:12345-0@lo:104: Request processed in 50us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.351334:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788873723.351367:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788873723.351372:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:10325:x1875769859040128:12345-0@lo:104: 00010000:00010000:3.0:1788873723.351380:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351402:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788873723.351407:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+7:10325:x1875769859040128:12345-0@lo:104: Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.351412:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788873723.351422:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788873723.351427:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:10325:x1875769859040256:12345-0@lo:104: 00010000:00010000:3.0:1788873723.351441:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351467:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788873723.351471:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:10325:x1875769859040256:12345-0@lo:104: Request processed in 45us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.351477:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788873723.351490:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788873723.351507:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:10325:x1875769859040384:12345-0@lo:104: 00010000:00010000:3.0:1788873723.351515:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.351515:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040000:0@lo:104: 00000100:00100000:0.0:1788873723.351522:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040128:0@lo:104: 00000100:00100000:0.0:1788873723.351528:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040256:0@lo:104: 00010000:00010000:3.0:1788873723.351551:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788873723.351556:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:10325:x1875769859040384:12345-0@lo:104: Request processed in 61us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.351559:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040384:0@lo:104: 00000100:00100000:3.0:1788873723.351562:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788873723.351573:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788873723.351579:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:10325:x1875769859040512:12345-0@lo:104: 00010000:00010000:3.0:1788873723.351586:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.351623:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788873723.351628:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:10325:x1875769859040512:12345-0@lo:104: Request processed in 50us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.351635:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788873723.351647:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788873723.351652:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:10325:x1875769859040640:12345-0@lo:104: 00010000:00010000:3.0:1788873723.351665:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.351735:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040512:0@lo:104: 00010000:00010000:3.0:1788873723.351759:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1788873723.351764:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:10325:x1875769859040640:12345-0@lo:104: Request processed in 112us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.351768:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859040640:0@lo:104: 00000100:00100000:3.0:1788873723.351770:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788873723.351786:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788873723.354689:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788873723.355147:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788873723.355157:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355167:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfea200 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873723.355171:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355181:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873723.355188:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873723.355193:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873723.355263:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355269:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873723.355285:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355303:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfea200/0x25c660afb0a9b566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b56d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355319:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788873723.355322:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355326:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873723.355329:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355335:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873723.355340:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873723.355345:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873723.355359:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355364:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873723.355369:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355375:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b527 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355383:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788873723.355390:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355395:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873723.355398:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355404:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873723.355410:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873723.355415:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873723.355427:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355433:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873723.355446:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355453:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93a00/0x25c660afb0a9b512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b519 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355461:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788873723.355464:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355469:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873723.355472:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355486:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873723.355493:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873723.355510:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873723.355526:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355531:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873723.355536:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355542:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92e00/0x25c660afb0a9b504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b50b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355551:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788873723.355554:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355559:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dc600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873723.355561:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355567:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873723.355573:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873723.355584:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873723.355598:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355603:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873723.355608:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355615:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dc600/0x25c660afb0a9b4c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4cc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355624:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873723.355627:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355632:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dd600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873723.355635:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355640:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873723.355645:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873723.355650:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873723.355662:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355667:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873723.355677:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355683:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dd600/0x25c660afb0a9b49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4a2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.355694:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873723.355696:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873723.355699:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873723.355719:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859041024:0@lo:103: 00000100:00100000:3.0:1788873723.355803:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.355848:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873723.355855:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859041152:0@lo:103: 00000100:00100000:3.0:1788873723.355877:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873723.356054:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041024 00000100:00100000:0.0:1788873723.356062:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041024 00010000:00010000:0.0:1788873723.356090:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 24 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.356115:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041152 00000100:00100000:0.0:1788873723.356118:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041152 00010000:00010000:0.0:1788873723.356128:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 25 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.356159:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788873723.356166:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458494050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3633:x1875769859041024:12345-0@lo:103: 00010000:00010000:0.0:1788873723.356179:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.356185:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.356194:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.356228:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b512 expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.356241:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.356278:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458494050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859041024:12345-0@lo:103: Request processed in 113us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.356285:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788873723.356326:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788873723.356332:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3633:x1875769859041152:12345-0@lo:103: 00010000:00010000:0.0:1788873723.356339:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.356343:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.356351:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.356361:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442600/0x25c660afb0a9b50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b504 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.356378:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.356399:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3633:x1875769859041152:12345-0@lo:103: Request processed in 68us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.356405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788873723.356444:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859041152:0@lo:103: 00000100:00100000:0.0:1788873723.356452:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859041024:0@lo:103: 00000100:00100000:3.0:1788873723.356818:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039360:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873723.356829:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875769859039488:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873723.356868:0:10325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873723.357242:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859040768:0@lo:103: 00000100:00100000:2.0:1788873723.357285:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873723.357325:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859041280:0@lo:103: 00000100:00100000:2.0:1788873723.357346:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873723.357366:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788873723.357373:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859040896:0@lo:103: 00000100:00100000:2.0:1788873723.357392:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873723.357406:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859041408:0@lo:103: 00000100:00100000:2.0:1788873723.357425:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873723.357456:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873723.357464:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873723.357469:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873723.357480:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873723.357488:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873723.357506:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788873723.357538:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873723.357545:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873723.357559:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873723.357577:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9b582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873723.357604:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873723.357606:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873723.357609:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873723.357698:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040768 00000100:00100000:0.0:1788873723.357706:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040768 00010000:00010000:0.0:1788873723.357732:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 22 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.357758:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041280 00000100:00100000:0.0:1788873723.357762:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041280 00010000:00010000:0.0:1788873723.357773:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.357782:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859040896 00000100:00100000:0.0:1788873723.357785:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859040896 00010000:00010000:0.0:1788873723.357794:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 24 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.357803:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041408 00000100:00100000:0.0:1788873723.357805:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041408 00010000:00010000:0.0:1788873723.357813:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.357826:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788873723.357833:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3635:x1875769859040768:12345-0@lo:103: 00010000:00010000:0.0:1788873723.357852:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.357857:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.357867:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.357880:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93c00/0x25c660afb0a9b56d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b566 expref: 25 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.357893:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.357936:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859040768:12345-0@lo:103: Request processed in 103us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.357942:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788873723.357958:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788873723.357965:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3635:x1875769859041280:12345-0@lo:103: 00010000:00010000:0.0:1788873723.357972:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.357976:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.357984:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873723.358288:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859040768:0@lo:103: 00010000:00010000:0.0:1788873723.358352:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d34821dc400/0x25c660afb0a9b4cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b4c5 expref: 23 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358363:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.358402:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3635:x1875769859041280:12345-0@lo:103: Request processed in 438us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.358418:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788873723.358433:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788873723.358439:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859040896:12345-0@lo:103: 00010000:00010000:0.0:1788873723.358448:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.358453:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 21 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358462:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 21 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358472:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b520 expref: 21 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358480:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.358520:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3635:x1875769859040896:12345-0@lo:103: Request processed in 81us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.358526:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788873723.358538:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788873723.358544:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3635:x1875769859041408:12345-0@lo:103: 00010000:00010000:0.0:1788873723.358551:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.358555:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 19 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358562:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 19 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358572:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b49b expref: 19 pid: 6505 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358602:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.358624:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3635:x1875769859041408:12345-0@lo:103: Request processed in 81us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.358630:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788873723.358656:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859041536:0@lo:103: 00000100:00100000:0.0:1788873723.358684:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873723.358716:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041536 00000100:00100000:0.0:1788873723.358720:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041536 00010000:00010000:0.0:1788873723.358734:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 18 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873723.358825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859040896:0@lo:103: 00000100:00100000:2.0:1788873723.358834:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859041408:0@lo:103: 00000100:00100000:2.0:1788873723.358840:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859041280:0@lo:103: 00000100:00100000:0.0:1788873723.358935:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788873723.358942:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3633:x1875769859041536:12345-0@lo:103: 00010000:00010000:0.0:1788873723.358951:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.358956:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 18 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358965:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 18 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358974:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b582 expref: 18 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.358983:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873723.359103:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873723.359111:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873723.359117:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873723.359174:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873723.359181:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873723.359195:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873723.359221:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93600/0x25c660afb0a9b5ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873723.359240:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859041664:0@lo:103: 00000100:00100000:1.0:1788873723.359270:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873723.359299:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041664 00000100:00100000:1.0:1788873723.359303:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041664 00010000:00010000:1.0:1788873723.359318:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 18 pid: 6503 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873723.359332:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873723.359337:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458497050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:3634:x1875769859041664:12345-0@lo:103: 00010000:00010000:1.0:1788873723.359345:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873723.359348:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 18 pid: 6503 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873723.359364:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 18 pid: 6503 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873723.359373:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215e200/0x25c660afb0a9b5b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b5ac expref: 18 pid: 6503 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873723.359382:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873723.359407:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458497050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:3634:x1875769859041664:12345-0@lo:103: Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873723.359413:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873723.359437:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859041664:0@lo:103: 00010000:00010000:1.0:1788873723.359454:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873723.359457:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873723.359459:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873723.359670:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3633:x1875769859041536:12345-0@lo:103: Request processed in 728us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.359677:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788873723.359953:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873723.359963:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873723.359965:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873723.359974:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.359982:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873723.359985:0:10332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.360004:0:10332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873723.360010:0:10332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873723.360015:0:10332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788873723.360036:0:10332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.360043:0:10332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873723.360054:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.360060:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92400/0x25c660afb0a9b53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b543 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.360074:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873723.360076:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873723.360077:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873723.360194:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873723.360234:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859041792:0@lo:103: 00000100:00100000:2.0:1788873723.360265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873723.360424:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859041536:0@lo:103: 00000100:00100000:0.0:1788873723.361619:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041792 00000100:00100000:0.0:1788873723.361630:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041792 00010000:00010000:0.0:1788873723.361675:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 16 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873723.361716:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873723.361724:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:3636:x1875769859041792:12345-0@lo:103: 00010000:00010000:0.0:1788873723.361735:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873723.361740:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 16 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.361760:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 16 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.361775:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215e800/0x25c660afb0a9b543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b53c expref: 16 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873723.361791:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873723.361851:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:3636:x1875769859041792:12345-0@lo:103: Request processed in 128us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873723.361859:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788873723.361945:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859041792:0@lo:103: 00000100:00100000:2.0:1788873723.363643:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873723.363730:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873723.364051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112256 00000100:00100000:3.0:1788873723.364061:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112256 00010000:00010000:3.0:1788873723.364098:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 10 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.364143:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112384 00000100:00100000:3.0:1788873723.364147:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112384 00010000:00010000:3.0:1788873723.364159:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 11 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.364177:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:3.0:1788873723.364198:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:2401:x1875769840112256:12345-192.168.202.20@tcp:103: 00010000:00010000:3.0:1788873723.364240:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873723.364246:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 11 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364258:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 11 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364273:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9b5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9492 expref: 11 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364288:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873723.364336:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840112256:12345-192.168.202.20@tcp:103: Request processed in 141us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.364343:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:3.0:1788873723.364359:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:3.0:1788873723.364365:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:2401:x1875769840112384:12345-192.168.202.20@tcp:103: 00010000:00010000:3.0:1788873723.364372:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873723.364376:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 9 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364385:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 9 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364394:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b5c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a948b expref: 9 pid: 6503 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364405:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364420:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364437:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364445:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364451:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364458:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364463:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92000 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873723.364467:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364475:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364491:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364517:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873723.364537:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:2401:x1875769840112384:12345-192.168.202.20@tcp:103: Request processed in 172us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.364543:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 34 00010000:00010000:3.0:1788873723.364569:0:10325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364585:0:10325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873723.364591:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b607 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873723.528346:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873723.528381:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873723.528422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112512 00000100:00100000:3.0:1788873723.528431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112512 00000100:00100000:3.0:1788873723.528487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:3.0:1788873723.528507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840112512:12345-192.168.202.20@tcp:400: 00000100:00100000:3.0:1788873723.528586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840112512:12345-192.168.202.20@tcp:400: Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.528594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:1.0:1788873723.529258:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112768 00000100:00100000:1.0:1788873723.529265:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112768 00000100:00100000:1.0:1788873723.529312:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:1.0:1788873723.529320:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840112768:12345-192.168.202.20@tcp:400: 00000100:00100000:1.0:1788873723.529366:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840112768:12345-192.168.202.20@tcp:400: Request processed in 47us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873723.529374:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00080000:1.0:1788873723.529510:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788873723.529515:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873723.538899:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873723.538939:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873723.539106:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112896 00000100:00100000:1.0:1788873723.539118:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112896 00000100:00100000:1.0:1788873723.539181:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:1.0:1788873723.539200:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840112896:12345-192.168.202.20@tcp:400: 00000100:00100000:1.0:1788873723.539297:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840112896:12345-192.168.202.20@tcp:400: Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873723.539305:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00080000:3.0:1788873723.539908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873723.540400:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840112640 00000100:00100000:2.0:1788873723.540407:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840112640 00000100:00100000:2.0:1788873723.540460:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:2.0:1788873723.540468:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840112640:12345-192.168.202.20@tcp:400: 00000100:00100000:2.0:1788873723.540528:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840112640:12345-192.168.202.20@tcp:400: Request processed in 60us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873723.540536:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00080000:3.0:1788873723.546503:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873723.631578:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859042048:0@lo:400: 00000100:00100000:3.0:1788873723.631664:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873723.631667:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859042304:0@lo:400: 00000100:00100000:2.0:1788873723.631697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.631723:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859042560:0@lo:400: 00000100:00100000:2.0:1788873723.631728:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859042816:0@lo:400: 00000100:00100000:3.0:1788873723.631747:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873723.631764:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042048 00000100:00100000:3.0:1788873723.631768:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859043072:0@lo:400: 00000100:00100000:2.0:1788873723.631772:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042048 00000100:00100000:3.0:1788873723.631789:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.631816:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788873723.631816:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042304 00000100:00100000:2.0:1788873723.631820:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042304 00000100:00100000:3.0:1788873723.631836:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859042176:0@lo:400: 00000100:00100000:2.0:1788873723.631837:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788873723.631845:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859042048:12345-0@lo:400: 00000100:00100000:3.0:1788873723.631858:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.631876:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859042688:0@lo:400: 00000100:00100000:1.0:1788873723.631927:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859041920:0@lo:400: 00000100:00100000:3.0:1788873723.632026:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.632062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788873723.633400:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859042304:12345-0@lo:400: 00000100:00100000:3.0:1788873723.633487:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859042304:12345-0@lo:400: Request processed in 1416us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.633507:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788873723.633567:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042560 00000100:00100000:3.0:1788873723.633574:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042560 00000100:00100000:3.0:1788873723.633685:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042176 00000100:00100000:3.0:1788873723.633690:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042176 00000100:00100000:3.0:1788873723.633707:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042688 00000100:00100000:3.0:1788873723.633711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042688 00000100:00100000:3.0:1788873723.633727:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788873723.633734:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859042560:12345-0@lo:400: 00000100:00100000:3.0:1788873723.633774:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859042560:12345-0@lo:400: Request processed in 41us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.633781:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788873723.633793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788873723.633799:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859042176:12345-0@lo:400: 00000100:00100000:3.0:1788873723.633827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859042176:12345-0@lo:400: Request processed in 29us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.633833:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788873723.633844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788873723.633849:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859042688:12345-0@lo:400: 00000100:00100000:3.0:1788873723.633895:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859042688:12345-0@lo:400: Request processed in 45us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.633901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788873723.633921:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043072 00000100:00100000:3.0:1788873723.633926:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043072 00000100:00100000:3.0:1788873723.633952:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788873723.633958:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859043072:12345-0@lo:400: 00000100:00100000:3.0:1788873723.633989:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859043072:12345-0@lo:400: Request processed in 31us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.633994:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788873723.634016:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873723.634020:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873723.634022:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873723.634062:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859042176:0@lo:400: 00000100:00100000:3.0:1788873723.634075:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859042688:0@lo:400: 00010000:00080000:3.0:1788873723.634088:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355180 x1875769859042560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873723.634098:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859042560:0@lo:400: 00010000:00080000:3.0:1788873723.634108:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355500 x1875769859043072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873723.634117:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859043072:0@lo:400: 00000100:00100000:3.0:1788873723.634769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873723.634819:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859042304:0@lo:400: 00000100:00100000:3.0:1788873723.634841:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042816 00000100:00100000:3.0:1788873723.634845:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042816 00000100:00100000:3.0:1788873723.634888:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788873723.634894:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859042816:12345-0@lo:400: 00000100:00100000:2.0:1788873723.635303:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859042048:12345-0@lo:400: Request processed in 3456us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873723.635313:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788873723.635359:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859042048:0@lo:400: 00000100:00100000:1.0:1788873723.635533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873723.635574:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859042432:0@lo:400: 00000100:00100000:1.0:1788873723.635885:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873723.635922:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859042944:0@lo:400: 00000100:00100000:1.0:1788873723.635947:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873723.635993:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042944 00000100:00100000:1.0:1788873723.635999:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042944 00000100:00100000:1.0:1788873723.636035:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788873723.636042:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859042944:12345-0@lo:400: 00000100:00100000:1.0:1788873723.636083:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859042944:12345-0@lo:400: Request processed in 40us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873723.636089:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788873723.636133:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f354a80 x1875769859042944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873723.636143:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859042944:0@lo:400: 00000100:00100000:3.0:1788873723.636258:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859042816:12345-0@lo:400: Request processed in 1362us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.636265:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788873723.636278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859041920 00000100:00100000:3.0:1788873723.636281:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859041920 00000100:00100000:3.0:1788873723.636299:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859042432 00000100:00100000:3.0:1788873723.636302:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859042432 00000100:00100000:3.0:1788873723.636317:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788873723.636322:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859041920:12345-0@lo:400: 00000100:00100000:2.0:1788873723.636337:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788873723.636345:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859042432:12345-0@lo:400: 00000100:00100000:3.0:1788873723.636354:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859041920:12345-0@lo:400: Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873723.636360:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788873723.636375:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873723.636375:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859042432:12345-0@lo:400: Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00080000:3.0:1788873723.636380:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873723.636381:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788873723.636382:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788873723.637052:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f356300 x1875769859042816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873723.637066:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859042816:0@lo:400: 00000100:00100000:1.0:1788873723.637099:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859041920:0@lo:400: 00000100:00100000:1.0:1788873723.637133:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859042432:0@lo:400: 00010000:00010000:3.0:1788873724.014478:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873724.143052:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859043200:0@lo:13: 00000100:00100000:3.0:1788873724.143136:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.143244:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043200 00000100:00100000:3.0:1788873724.143253:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043200 00000100:00100000:3.0:1788873724.143299:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788873724.143308:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859043200:12345-0@lo:13: 00002000:00000024:3.0:1788873724.143339:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873724.143390:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859043200:12345-0@lo:13: Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.143397:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788873724.143456:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abd180 x1875769859043200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873724.143475:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859043200:0@lo:13: 00000100:00100000:1.0:1788873724.143638:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859043456:0@lo:13: 00000100:00100000:1.0:1788873724.143668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.143697:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873724.143703:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859043328:0@lo:41: 00000100:00100000:1.0:1788873724.143726:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.143755:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043328 00000100:00100000:1.0:1788873724.143760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043328 00000100:00100000:1.0:1788873724.143785:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788873724.143792:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859043328:12345-0@lo:41: 00000004:00000024:1.0:1788873724.143816:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873724.143852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859043328:12345-0@lo:41: Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.143858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788873724.143886:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859043328:0@lo:41: 00000100:00100000:3.0:1788873724.147106:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043456 00000100:00100000:3.0:1788873724.147120:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043456 00000100:00100000:3.0:1788873724.147187:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788873724.147198:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859043456:12345-0@lo:13: 00002000:00000024:3.0:1788873724.147249:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873724.147347:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859043456:12345-0@lo:13: Request processed in 150us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.147355:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788873724.147500:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a727100 x1875769859043456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873724.147524:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859043456:0@lo:13: 10000000:01000000:1.0:1788873724.462451:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788873724.462469:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3341ecd800 from 48 10000000:01000000:1.0:1788873724.462475:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788873724.462555:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.462567:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.462598:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.462624:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859043584:0@lo:101: 00000100:00100000:1.0:1788873724.462702:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.462776:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.462865:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043584 00000100:00100000:2.0:1788873724.462873:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043584 00000100:00100000:2.0:1788873724.462935:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788873724.462945:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+15:6508:x1875769859043584:12345-0@lo:101: 00010000:00010000:2.0:1788873724.462958:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873724.462972:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215ea00/0x25c660afb0a9b615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b60e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.462997:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215ea00/0x25c660afb0a9b615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b60e expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.463017:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215ea00/0x25c660afb0a9b615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b60e expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.463026:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ea00, rc 0) 00000100:00100000:2.0:1788873724.463074:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859043584:12345-0@lo:101: Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873724.463080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788873724.463290:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859043584:0@lo:101: 00010000:00010000:3.0:1788873724.463305:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.463315:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.463375:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859043712:0@lo:501: 00000100:00100000:3.0:1788873724.463402:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.463440:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.463501:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043712 00000100:00100000:0.0:1788873724.463506:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043712 00000100:00100000:0.0:1788873724.463541:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788873724.463548:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859043712:12345-0@lo:501: 00000100:00100000:0.0:1788873724.463670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859043712:12345-0@lo:501: Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.463678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788873724.463821:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859043712:0@lo:501: 00000100:00100000:3.0:1788873724.463849:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859043840:0@lo:503: 00000100:00100000:3.0:1788873724.463889:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.463911:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.464025:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043840 00000100:00100000:0.0:1788873724.464030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043840 00000100:00100000:0.0:1788873724.464059:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788873724.464066:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859043840:12345-0@lo:503: 00000100:00100000:0.0:1788873724.464160:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859043840:12345-0@lo:503: Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.464308:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859043840:0@lo:503: 00000100:00100000:0.0:1788873724.464705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788873724.464870:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10346:1875769859043968:0@lo:502: 00000100:00100000:3.0:1788873724.464912:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.464946:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.465002:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859043968 00000100:00100000:1.0:1788873724.465008:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859043968 00000100:00100000:1.0:1788873724.465046:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788873724.465053:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:10346:x1875769859043968:12345-0@lo:502: 00000100:00100000:1.0:1788873724.465160:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:10346:x1875769859043968:12345-0@lo:502: Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.465303:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788873724.469667:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10346:1875769859043968:0@lo:502: 00000100:00100000:3.0:1788873724.469774:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10346:1875769859044096:0@lo:502: 00000100:00100000:3.0:1788873724.469852:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.469914:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.472709:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044096 00000100:00100000:0.0:1788873724.472726:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044096 00000100:00100000:0.0:1788873724.472816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788873724.472828:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:10346:x1875769859044096:12345-0@lo:502: 00000100:00100000:0.0:1788873724.473352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:10346:x1875769859044096:12345-0@lo:502: Request processed in 525us (3499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.473361:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788873724.479523:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10346:1875769859044096:0@lo:502: 00000040:00080000:3.0:1788873724.479586:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788873724.480977:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788873724.481002:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788873724.481011:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.481020:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873724.481028:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788873724.481030:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788873724.481032:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788873724.481077:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.481083:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.481101:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.481118:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044224:0@lo:101: 00000100:00100000:1.0:1788873724.481190:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.481253:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab840 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.482184:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044224 00000100:00100000:0.0:1788873724.482194:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044224 00000100:00100000:0.0:1788873724.482276:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788873724.482286:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+16:6508:x1875769859044224:12345-0@lo:101: 00010000:00010000:0.0:1788873724.482300:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873724.482313:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b61c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.482342:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b61c expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.482350:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b61c expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.482357:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92600, rc 0) 00000100:00100000:0.0:1788873724.482403:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859044224:12345-0@lo:101: Request processed in 120us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.482408:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788873724.482601:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044224:0@lo:101: 00010000:00010000:3.0:1788873724.482616:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.482631:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.482707:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044352:0@lo:501: 00000100:00100000:3.0:1788873724.482738:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.482780:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.482932:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044352 00000100:00100000:0.0:1788873724.482936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044352 00000100:00100000:0.0:1788873724.482962:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788873724.482966:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859044352:12345-0@lo:501: 00000100:00100000:0.0:1788873724.483065:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859044352:12345-0@lo:501: Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.483070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788873724.483310:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044352:0@lo:501: 00000100:00100000:3.0:1788873724.483341:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044480:0@lo:503: 00000100:00100000:3.0:1788873724.483373:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.483394:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.483475:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044480 00000100:00100000:0.0:1788873724.483478:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044480 00000100:00100000:0.0:1788873724.483516:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788873724.483523:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859044480:12345-0@lo:503: 00000100:00100000:0.0:1788873724.483588:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859044480:12345-0@lo:503: Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.483593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788873724.483840:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044480:0@lo:503: 00000100:00100000:0.0:1788873724.488529:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10347:1875769859044608:0@lo:502: 00000100:00100000:0.0:1788873724.494742:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.494807:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf840 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.494871:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044608 00000100:00100000:3.0:1788873724.494881:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044608 00000100:00100000:3.0:1788873724.494923:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788873724.494930:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:10347:x1875769859044608:12345-0@lo:502: 00000100:00100000:3.0:1788873724.495079:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:10347:x1875769859044608:12345-0@lo:502: Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.495084:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788873724.496250:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10347:1875769859044608:0@lo:502: 00000020:01000000:0.0:1788873724.496295:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873724.496307:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873724.496310:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788873724.496315:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788873724.496357:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10347:1875769859044736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.496400:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.496421:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.496797:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044736 00000100:00100000:3.0:1788873724.496815:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044736 00000100:00100000:3.0:1788873724.496855:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788873724.496864:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:10347:x1875769859044736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.496968:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:10347:x1875769859044736:12345-0@lo:502:llog_process_th.0 Request processed in 105us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.496974:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788873724.497063:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10347:1875769859044736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873724.497080:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873724.497083:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873724.497084:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788873724.497088:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788873724.497519:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788873724.497540:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788873724.497550:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.497557:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873724.497564:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788873724.497567:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3476df3800 from 48 10000000:01000000:3.0:1788873724.497568:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788873724.497588:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.497602:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.497609:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.497620:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.497659:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.497690:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.497936:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044864 00000100:00100000:0.0:1788873724.497940:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044864 00000100:00100000:0.0:1788873724.497978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788873724.497984:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+17:6508:x1875769859044864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873724.497991:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873724.498002:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b62a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.498019:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b62a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.498027:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b62a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.498034:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93800, rc 0) 00000100:00100000:0.0:1788873724.498069:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859044864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.498072:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788873724.498288:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873724.498300:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.498306:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.498357:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.498377:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.498400:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.498524:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859044992 00000100:00100000:2.0:1788873724.498530:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859044992 00000100:00100000:2.0:1788873724.498554:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788873724.498561:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859044992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.498686:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859044992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873724.498874:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788873724.498984:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859044992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.499010:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.499041:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.499067:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.499155:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045120 00000100:00100000:1.0:1788873724.499167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045120 00000100:00100000:1.0:1788873724.499201:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788873724.499232:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859045120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.499316:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859045120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.499321:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788873724.499833:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.503079:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10348:1875769859045248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.503156:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.503325:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.503453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045248 00000100:00100000:0.0:1788873724.503461:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045248 00000100:00100000:0.0:1788873724.503521:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788873724.503531:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:10348:x1875769859045248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.503687:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:10348:x1875769859045248:12345-0@lo:502:llog_process_th.0 Request processed in 157us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.503770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788873724.504544:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10348:1875769859045248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.504614:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10348:1875769859045376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.504678:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.505498:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.509043:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045376 00000100:00100000:3.0:1788873724.509083:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045376 00000100:00100000:3.0:1788873724.509147:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788873724.509157:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:10348:x1875769859045376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.509375:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:10348:x1875769859045376:12345-0@lo:502:llog_process_th.0 Request processed in 219us (4696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.509383:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788873724.509555:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10348:1875769859045376:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788873724.509591:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788873724.510178:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788873724.510228:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788873724.510239:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.510251:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873724.510262:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788873724.510264:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788873724.510267:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788873724.510298:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.510306:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.510316:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.510349:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.510395:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.510431:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.510524:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045504 00000100:00100000:1.0:1788873724.510531:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045504 00000100:00100000:1.0:1788873724.510572:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788873724.510581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+18:6508:x1875769859045504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873724.510592:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873724.510604:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfeb400/0x25c660afb0a9b63f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b638 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.510639:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeb400/0x25c660afb0a9b63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b638 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.510650:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfeb400/0x25c660afb0a9b63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b638 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.510670:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeb400, rc 0) 00000100:00100000:1.0:1788873724.510717:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859045504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.510723:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788873724.511200:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873724.511233:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.511243:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.511298:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.511329:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.511373:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.511437:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045632 00000100:00100000:0.0:1788873724.511441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045632 00000100:00100000:0.0:1788873724.511478:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788873724.511497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859045632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.511607:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859045632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.511633:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788873724.511966:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.511996:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.512036:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.512075:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.512231:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045760 00000100:00100000:1.0:1788873724.512236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045760 00000100:00100000:1.0:1788873724.512266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788873724.512273:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859045760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.512385:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859045760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.512392:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788873724.513561:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859045760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.514549:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10349:1875769859045888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.514614:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.514664:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.514822:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859045888 00000100:00100000:1.0:1788873724.514829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859045888 00000100:00100000:1.0:1788873724.514874:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788873724.514884:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:10349:x1875769859045888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873724.515008:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:10349:x1875769859045888:12345-0@lo:502:llog_process_th.0 Request processed in 126us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.515016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788873724.515315:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10349:1875769859045888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788873724.515355:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873724.515365:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873724.515368:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788873724.515373:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788873724.515396:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10349:1875769859046016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.515429:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.515459:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.515578:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046016 00000100:00100000:3.0:1788873724.515583:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046016 00000100:00100000:3.0:1788873724.515630:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788873724.515637:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:10349:x1875769859046016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.515731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:10349:x1875769859046016:12345-0@lo:502:llog_process_th.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.515738:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788873724.516093:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10349:1875769859046016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788873724.516115:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873724.516119:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873724.516121:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788873724.516124:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788873724.516438:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788873724.516462:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788873724.516472:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.516492:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873724.516511:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788873724.516514:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34651cb800 from 48 10000000:01000000:3.0:1788873724.516517:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788873724.516542:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.516550:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.516559:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.516576:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.516611:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.516655:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.516944:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046144 00000100:00100000:0.0:1788873724.516951:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046144 00000100:00100000:0.0:1788873724.516994:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788873724.517001:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:6508:x1875769859046144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873724.517012:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873724.517025:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b64d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b646 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.517072:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b646 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.517082:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b646 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873724.517091:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93e00, rc 0) 00000100:00100000:0.0:1788873724.517131:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859046144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.517138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788873724.517303:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873724.517318:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.517326:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.517396:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.517422:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.517449:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.517462:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046272 00000100:00100000:3.0:1788873724.517465:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046272 00000100:00100000:3.0:1788873724.524099:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788873724.524122:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859046272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.524511:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859046272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 398us (7087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.524519:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788873724.533531:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.533602:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.533682:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.533734:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.533953:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046400 00000100:00100000:1.0:1788873724.533960:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046400 00000100:00100000:1.0:1788873724.534015:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788873724.534025:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859046400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.534153:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859046400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.534160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788873724.534480:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.535097:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10350:1875769859046528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.535144:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.535187:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.535395:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046528 00000100:00100000:1.0:1788873724.535402:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046528 00000100:00100000:1.0:1788873724.535443:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788873724.535452:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:10350:x1875769859046528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873724.535572:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:10350:x1875769859046528:12345-0@lo:502:llog_process_th.0 Request processed in 120us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.535578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788873724.535924:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10350:1875769859046528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.535971:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10350:1875769859046656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.536009:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.536037:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.536368:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046656 00000100:00100000:1.0:1788873724.536373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046656 00000100:00100000:1.0:1788873724.536413:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788873724.536421:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:10350:x1875769859046656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873724.536523:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:10350:x1875769859046656:12345-0@lo:502:llog_process_th.0 Request processed in 102us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.536530:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788873724.536669:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10350:1875769859046656:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788873724.536708:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788873724.537605:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788873724.537650:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788873724.537661:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.537674:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873724.537686:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788873724.537688:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788873724.537701:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788873724.537735:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.537744:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.537764:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.537784:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.538320:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.538454:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654240 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.541619:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046784 00000100:00100000:0.0:1788873724.541634:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046784 00000100:00100000:1.0:1788873724.542947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788873724.542960:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859046784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873724.542981:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873724.543003:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfea200/0x25c660afb0a9b65b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b654 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.543033:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfea200/0x25c660afb0a9b65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b654 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.543045:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfea200/0x25c660afb0a9b65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b654 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.543329:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfea200, rc 0) 00000100:00100000:1.0:1788873724.543524:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859046784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 566us (5203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.543531:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788873724.557001:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873724.557033:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.557046:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873724.557458:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.557539:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.557600:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.559234:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859046912 00000100:00100000:2.0:1788873724.559248:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859046912 00000100:00100000:2.0:1788873724.559309:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788873724.559320:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859046912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.559520:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859046912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873724.559528:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788873724.559817:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859046912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.559869:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.559926:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.559973:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.560263:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047040 00000100:00100000:2.0:1788873724.560269:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047040 00000100:00100000:2.0:1788873724.560297:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788873724.560305:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859047040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.560454:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859047040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873724.560461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788873724.560790:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.562118:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10351:1875769859047168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.562454:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873724.563495:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.570532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047168 00000100:00100000:2.0:1788873724.570550:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047168 00000100:00100000:2.0:1788873724.570610:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788873724.570634:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10351:x1875769859047168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.571070:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10351:x1875769859047168:12345-0@lo:502:llog_process_th.0 Request processed in 437us (8615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873724.571077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788873724.575427:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10351:1875769859047168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873724.575511:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873724.575525:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873724.575527:0:10351:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788873724.575533:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788873724.575574:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10351:1875769859047296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.575651:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873724.575774:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047296 00000100:00100000:0.0:1788873724.575781:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047296 00000100:00100000:0.0:1788873724.575836:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788873724.575847:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10351:x1875769859047296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.575954:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33435e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.576001:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10351:x1875769859047296:12345-0@lo:502:llog_process_th.0 Request processed in 155us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.576009:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788873724.576017:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10351:1875769859047296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873724.576040:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873724.576044:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873724.576046:0:10351:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788873724.576049:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788873724.576907:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788873724.576935:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788873724.576947:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.576972:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873724.576982:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788873724.576985:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d34473c7800 from 48 10000000:01000000:1.0:1788873724.576987:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788873724.577016:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.577024:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.577033:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.577050:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.577093:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.577177:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.578146:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047424 00000100:00100000:2.0:1788873724.578156:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047424 00000100:00100000:3.0:1788873724.578357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788873724.578366:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859047424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873724.578379:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873724.578395:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443000/0x25c660afb0a9b669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b662 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.578421:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443000/0x25c660afb0a9b669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b662 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.578431:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443000/0x25c660afb0a9b669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b662 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.578439:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443000, rc 0) 00000100:00100000:3.0:1788873724.578517:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859047424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.578524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788873724.578660:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873724.578676:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.578686:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873724.578764:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.578794:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.578834:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.578941:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047552 00000100:00100000:0.0:1788873724.578946:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047552 00000100:00100000:0.0:1788873724.578983:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788873724.578991:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859047552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.579119:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859047552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.579126:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788873724.579264:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.579293:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.579348:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.579374:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.579433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047680 00000100:00100000:3.0:1788873724.579438:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047680 00000100:00100000:3.0:1788873724.579468:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788873724.579475:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859047680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.579581:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859047680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.579588:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788873724.579636:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859047680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.580102:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10352:1875769859047808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.580137:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.580166:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488540 going to sleep for 11 seconds 00000100:00100000:1.0:1788873724.580436:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047808 00000100:00100000:1.0:1788873724.580441:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047808 00000100:00100000:1.0:1788873724.580477:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788873724.580494:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10352:x1875769859047808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873724.580591:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10352:x1875769859047808:12345-0@lo:502:llog_process_th.0 Request processed in 106us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.580598:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788873724.580708:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10352:1875769859047808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.580751:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10352:1875769859047936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.580783:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.580820:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488540 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.580860:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859047936 00000100:00100000:0.0:1788873724.580864:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859047936 00000100:00100000:0.0:1788873724.580899:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788873724.580906:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10352:x1875769859047936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873724.581001:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10352:x1875769859047936:12345-0@lo:502:llog_process_th.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.581008:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788873724.581024:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10352:1875769859047936:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788873724.581043:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788873724.584952:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788873724.584991:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788873724.585021:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.585034:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873724.585045:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788873724.585048:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788873724.585051:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788873724.585088:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.585095:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.585105:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.585128:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.586438:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.586509:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.586575:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048064 00000100:00100000:3.0:1788873724.586595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048064 00000100:00100000:3.0:1788873724.586652:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788873724.586662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859048064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873724.586678:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873724.586703:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442c00/0x25c660afb0a9b677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b670 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.586729:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442c00/0x25c660afb0a9b677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b670 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.586741:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442c00/0x25c660afb0a9b677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b670 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.586750:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442c00, rc 0) 00000100:00100000:3.0:1788873724.586828:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859048064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.586835:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788873724.586980:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873724.586998:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.587008:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873724.587085:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.587117:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.587140:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488540 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.587259:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048192 00000100:00100000:0.0:1788873724.587264:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048192 00000100:00100000:0.0:1788873724.587295:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788873724.587310:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859048192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.587438:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859048192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.587446:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788873724.587523:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.587552:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.587591:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.587616:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488540 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.587638:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048320 00000100:00100000:0.0:1788873724.587642:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048320 00000100:00100000:0.0:1788873724.587660:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788873724.587666:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859048320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873724.587798:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859048320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873724.587804:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788873724.588226:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873724.588824:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10353:1875769859048448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.588870:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.588910:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488480 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.589015:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048448 00000100:00100000:3.0:1788873724.589021:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048448 00000100:00100000:3.0:1788873724.589064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788873724.589073:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10353:x1875769859048448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873724.589190:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10353:x1875769859048448:12345-0@lo:502:llog_process_th.0 Request processed in 118us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873724.589198:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788873724.589539:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10353:1875769859048448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873724.589573:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873724.589582:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873724.589584:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788873724.589591:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788873724.589614:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10353:1875769859048576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873724.589647:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873724.589677:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488480 going to sleep for 11 seconds 00000100:00100000:0.0:1788873724.589704:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048576 00000100:00100000:0.0:1788873724.589709:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048576 00000100:00100000:0.0:1788873724.589744:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788873724.589751:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10353:x1875769859048576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873724.589909:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10353:x1875769859048576:12345-0@lo:502:llog_process_th.0 Request processed in 157us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873724.589917:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788873724.591384:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10353:1875769859048576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873724.591423:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873724.591431:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873724.591433:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788873724.591438:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788873724.591679:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788873724.591714:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788873724.591725:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.591736:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873724.591758:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788873724.591761:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3480da19c0 from 1 10000000:01000000:1.0:1788873724.591764:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788873724.591798:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.591817:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.591826:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.591845:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.591897:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.591936:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345845f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873724.592098:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048704 00000100:00100000:2.0:1788873724.592106:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048704 00000100:00100000:2.0:1788873724.592153:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788873724.592288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859048704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873724.592303:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873724.592316:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215e000/0x25c660afb0a9b685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b67e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.592400:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215e000/0x25c660afb0a9b685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b67e expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.592412:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215e000/0x25c660afb0a9b685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b67e expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873724.592421:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e000, rc 0) 00000100:00100000:2.0:1788873724.592456:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859048704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873724.592469:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788873724.592560:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873724.592574:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873724.592583:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873724.592637:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873724.592662:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873724.592731:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345845f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873724.595565:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048832 00000100:00100000:3.0:1788873724.595578:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048832 00000100:00100000:3.0:1788873724.595640:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788873724.595651:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859048832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873724.595903:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859048832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (3238us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788873724.595911:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788873724.596570:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859048832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788873724.596796:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788873724.596818:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873724.596830:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873725.040871:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873725.192627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873725.192745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113024 00000100:00100000:2.0:1788873725.192758:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113024 00000100:00100000:2.0:1788873725.192840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 242 00000100:00100000:2.0:1788873725.192852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:6175:x1875769840113024:12345-192.168.202.20@tcp:101: 00010000:00010000:2.0:1788873725.192875:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873725.192900:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b68c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9502 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873725.192937:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9502 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873725.192952:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9502 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873725.192963:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f600, rc 0) 00000100:00100000:2.0:1788873725.193042:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840113024:12345-192.168.202.20@tcp:101: Request processed in 181us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873725.193050:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 242 00000100:00100000:2.0:1788873725.206172:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873725.206748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113152 00000100:00100000:1.0:1788873725.206762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113152 00000100:00100000:1.0:1788873725.206862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 243 00000100:00100000:1.0:1788873725.206876:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840113152:12345-192.168.202.20@tcp:501: 00000100:00100000:1.0:1788873725.207112:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840113152:12345-192.168.202.20@tcp:501: Request processed in 238us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873725.207121:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 243 00000100:00100000:1.0:1788873725.211626:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873725.211812:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113280 00000100:00100000:3.0:1788873725.211826:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113280 00000100:00100000:3.0:1788873725.211901:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 244 00000100:00100000:3.0:1788873725.211915:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840113280:12345-192.168.202.20@tcp:503: 00000100:00100000:3.0:1788873725.212118:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840113280:12345-192.168.202.20@tcp:503: Request processed in 205us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873725.212126:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 244 00000100:00100000:0.0:1788873725.224444:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873725.224624:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113408 00000100:00100000:2.0:1788873725.224639:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113408 00000100:00100000:2.0:1788873725.224711:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 245 00000100:00100000:2.0:1788873725.224724:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6653:x1875769840113408:12345-192.168.202.20@tcp:502: 00000100:00100000:2.0:1788873725.224980:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6653:x1875769840113408:12345-192.168.202.20@tcp:502: Request processed in 248us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873725.224989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 245 00000100:00100000:2.0:1788873725.240307:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873725.242145:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113536 00000100:00100000:1.0:1788873725.242167:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113536 00000100:00100000:1.0:1788873725.242293:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 246 00000100:00100000:1.0:1788873725.242306:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6653:x1875769840113536:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788873725.242535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6653:x1875769840113536:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 231us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873725.242544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 246 00000100:00100000:1.0:1788873725.252199:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873725.252361:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113664 00000100:00100000:3.0:1788873725.252375:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113664 00000100:00100000:3.0:1788873725.252450:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 247 00000100:00100000:3.0:1788873725.252462:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840113664:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873725.252494:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873725.252520:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442200/0x25c660afb0a9b693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9509 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873725.252559:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442200/0x25c660afb0a9b693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9509 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873725.252599:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442200/0x25c660afb0a9b693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9509 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873725.252613:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442200, rc 0) 00000100:00100000:3.0:1788873725.252693:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840113664:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 232us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873725.252701:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 247 00000100:00100000:0.0:1788873725.258684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873725.258803:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113792 00000100:00100000:2.0:1788873725.258817:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113792 00000100:00100000:2.0:1788873725.258896:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 248 00000100:00100000:2.0:1788873725.258909:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840113792:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873725.259077:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840113792:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873725.259086:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 248 00010000:00010000:1.0:1788873726.064708:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873726.703343:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859048960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873726.703414:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873726.703504:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859048960 00000100:00100000:2.0:1788873726.703511:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859048960 00000100:00100000:2.0:1788873726.705936:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788873726.705958:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859048960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873726.705998:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788873726.706088:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859048960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873726.706095:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788873726.706297:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859048960:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788873727.059769:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd219832e0 20000000:00000080:2.0:1788873727.059789:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347a6a6800 uarg=0000000000000000 20000000:01000000:2.0:1788873727.059833:0:10390:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788873727.059839:0:10390:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788873727.059844:0:10390:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788873727.060416:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788873727.060648:0:10390:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788873727.064432:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788873727.064486:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788873727.064502:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788873727.064518:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788873727.064537:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064556:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064565:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064572:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064579:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064589:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064596:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064634:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064650:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 9 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.064683:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049088:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873727.064787:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064796:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 23 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.064805:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049216:0@lo:104: 00000100:00100000:2.0:1788873727.064857:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873727.064893:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.064902:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 23 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.064911:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049344:0@lo:104: 00000100:00100000:2.0:1788873727.064935:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873727.065154:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788873727.065166:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049216 00000100:00100000:1.0:1788873727.065172:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049216 00000100:00100000:1.0:1788873727.065228:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049344 00000100:00100000:1.0:1788873727.065231:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049344 00000100:00100000:1.0:1788873727.065247:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788873727.065255:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:10390:x1875769859049216:12345-0@lo:104: 00010000:00010000:1.0:1788873727.065269:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873727.065319:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788873727.065325:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:10390:x1875769859049216:12345-0@lo:104: Request processed in 71us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873727.065339:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788873727.065357:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788873727.065363:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d344fc3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:10390:x1875769859049344:12345-0@lo:104: 00010000:00010000:1.0:1788873727.065370:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873727.065834:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788873727.065841:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d344fc3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:10390:x1875769859049344:12345-0@lo:104: Request processed in 478us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873727.065848:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788873727.065945:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.066734:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 23 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.066749:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049472:0@lo:104: 00000100:00100000:2.0:1788873727.066799:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873727.067087:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788873727.067096:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067104:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dde00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873727.067108:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067129:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873727.067135:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873727.067142:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873727.067182:0:10333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067189:0:10333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873727.067223:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067230:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dde00/0x25c660afb0a9b4b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b4be expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067245:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873727.067248:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067253:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfeb600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873727.067256:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067263:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873727.067268:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873727.067280:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873727.067295:0:10333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067300:0:10333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873727.067313:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067319:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfeb600/0x25c660afb0a9b391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b398 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067328:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873727.067329:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873727.067331:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873727.067337:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873727.067349:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859049600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873727.067381:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873727.067428:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859049728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873727.067451:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873727.067491:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049600 00000100:00100000:0.0:1788873727.067497:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049600 00010000:00010000:0.0:1788873727.067524:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 24 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873727.067547:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049728 00000100:00100000:0.0:1788873727.067550:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049728 00010000:00010000:0.0:1788873727.067562:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 25 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873727.067592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788873727.067600:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3634:x1875769859049600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873727.067611:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873727.067616:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 25 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067625:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 25 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067642:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873727.067671:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3634:x1875769859049600:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873727.067678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788873727.067696:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873727.067702:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859049728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873727.067709:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873727.067714:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 24 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067722:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 24 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.067730:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873727.067754:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859049728:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873727.067760:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873727.067798:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859049728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873727.067832:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859049600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788873727.068008:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.068030:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 23 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.068039:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049856:0@lo:104: 00000100:00100000:2.0:1788873727.068065:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873727.068768:0:10390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b820c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788873727.068787:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d34821dd000/0x25c660afb0a9b4be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b4b7 expref: 23 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.068799:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049216:0@lo:104: 00010000:00010000:2.0:1788873727.068809:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b391 expref: 22 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.068818:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049344:0@lo:104: 00000100:00100000:1.0:1788873727.071065:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049472 00000100:00100000:1.0:1788873727.071079:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049472 00000100:00100000:0.0:1788873727.071979:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873727.072037:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049856 00000100:00100000:0.0:1788873727.072042:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049856 00000100:00100000:0.0:1788873727.072056:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788873727.072065:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:10390:x1875769859049472:12345-0@lo:104: 00010000:00010000:0.0:1788873727.072084:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072281:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873727.072288:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:10390:x1875769859049472:12345-0@lo:104: Request processed in 224us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873727.072296:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788873727.072314:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873727.072321:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:10390:x1875769859049856:12345-0@lo:104: 00010000:00010000:0.0:1788873727.072330:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072369:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788873727.072374:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:10390:x1875769859049856:12345-0@lo:104: Request processed in 54us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873727.072379:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788873727.072396:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788873727.072401:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072409:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d34821dc000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873727.072430:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072439:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873727.072446:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873727.072452:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873727.072499:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072506:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873727.072526:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072534:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d34821dc000/0x25c660afb0a9b33d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b344 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072548:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873727.072551:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072557:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873727.072560:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072566:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873727.072583:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873727.072588:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873727.072602:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072608:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873727.072621:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072627:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b32f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b336 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.072640:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873727.072642:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873727.072644:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873727.072657:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859050112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873727.072697:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873727.072745:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840113920 00000100:00100000:0.0:1788873727.072749:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840113920 00010000:00010000:0.0:1788873727.072769:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 10 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873727.072788:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050112 00000100:00100000:0.0:1788873727.072791:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050112 00000100:00100000:1.0:1788873727.072912:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:1.0:1788873727.072922:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840113920:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873727.072934:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873727.072940:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 10 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873727.072963:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 10 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873727.072982:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873727.073022:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840113920:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 103us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873727.073029:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:1.0:1788873727.074287:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859049984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873727.074352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873727.074405:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859049984 00000100:00100000:1.0:1788873727.074410:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859049984 00010000:00010000:1.0:1788873727.074434:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 22 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873727.074471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788873727.074480:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3636:x1875769859049984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788873727.074491:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873727.074495:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 22 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873727.074506:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 22 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873727.074521:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873727.074551:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3636:x1875769859049984:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873727.074559:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788873727.074595:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859049984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873727.074688:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 22 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873727.074707:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873727.074720:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458495850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3633:x1875769859050112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873727.074729:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873727.074733:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 22 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.074742:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 22 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.074754:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.074763:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.074779:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.074785:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.074791:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873727.075198:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873727.075442:0:9516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.075449:0:9516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215f800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873727.075454:0:9516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.075472:0:9516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.075493:0:9516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873727.075506:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873727.075606:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458495850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3633:x1875769859050112:12345-0@lo:103:ldlm_bl.0 Request processed in 884us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873727.075615:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1788873727.075755:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9b5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a94ca expref: 9 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.075769:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435a0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049088:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873727.075783:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d34821dda00/0x25c660afb0a9b344 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b33d expref: 21 pid: 6506 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.075792:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049472:0@lo:104: 00010000:00010000:2.0:1788873727.075815:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b32f expref: 20 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873727.075823:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875769859049856:0@lo:104: 00010000:00010000:2.0:1788873727.075848:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.075865:0:10390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.075871:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873727.075877:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f800/0x25c660afb0a9b69a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873727.078852:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859050112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873727.088546:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873728.110566:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873728.242625:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788873728.242647:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859050240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873728.242718:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873728.242748:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050240 00000100:00100000:3.0:1788873728.242757:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050240 00000100:00100000:3.0:1788873728.242819:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788873728.242825:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788873728.242831:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859050240:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873728.242837:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788873728.242863:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873728.242923:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859050240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.242930:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788873728.242952:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873728.242980:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885880 x1875769859050240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873728.242999:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859050240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873728.246030:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859050368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873728.246105:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873728.246232:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050368 00000100:00100000:1.0:1788873728.246239:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050368 00000100:00100000:1.0:1788873728.246296:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873728.246305:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859050368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873728.246326:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873728.246371:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859050368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.246389:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788873728.246432:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347a727100 x1875769859050368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873728.246464:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859050368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788873728.246592:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873728.654319:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873728.654368:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873728.654396:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873728.654417:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873728.654459:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873728.654486:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114304 00000100:00100000:1.0:1788873728.654496:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114304 00000100:00100000:1.0:1788873728.654552:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114176 00000100:00100000:1.0:1788873728.654556:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114176 00000100:00100000:1.0:1788873728.654580:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 73 00000100:00100000:1.0:1788873728.654590:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840114304:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873728.654665:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840114304:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.654672:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 73 00000100:00100000:1.0:1788873728.654690:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 74 00000100:00100000:1.0:1788873728.654696:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840114176:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873728.654722:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840114176:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.654728:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 74 00000100:00080000:1.0:1788873728.654745:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873728.654748:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873728.655056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114048 00000100:00100000:3.0:1788873728.655061:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114048 00000100:00100000:3.0:1788873728.655102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 249 00000100:00100000:3.0:1788873728.655110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:2400:x1875769840114048:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873728.655156:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:2400:x1875769840114048:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 45us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.655169:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 249 00000100:00100000:3.0:1788873728.655250:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114560 00000100:00100000:3.0:1788873728.655255:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114560 00000100:00100000:3.0:1788873728.655292:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114432 00000100:00100000:3.0:1788873728.655307:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114432 00000100:00100000:3.0:1788873728.655340:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:3.0:1788873728.655348:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840114560:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873728.655425:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840114560:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 77us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.655433:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00080000:1.0:1788873728.655889:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788873728.655893:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873728.656929:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:0.0:1788873728.656959:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840114432:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873728.657017:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840114432:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 78us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873728.657025:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:2.0:1788873728.752577:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859050880:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.752647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.752701:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859051392:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.752734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.752760:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788873728.752766:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859050496:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.752793:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.752816:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859051008:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.752840:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.752873:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.752910:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.752940:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859050624:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.752960:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.752982:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859051136:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.753029:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.753049:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859051648:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.753072:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.754308:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788873728.754326:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859050752:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.754375:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.754410:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.754432:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.755253:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859051776:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.755291:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873728.755340:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051008 00000100:00100000:2.0:1788873728.755348:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051008 00000100:00100000:2.0:1788873728.755390:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050752 00000100:00100000:2.0:1788873728.755394:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050752 00000100:00100000:2.0:1788873728.755410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788873728.755418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859051008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.756690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859051008:12345-0@lo:400:kworker.0 Request processed in 1266us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873728.756702:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788873728.756838:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050880 00000100:00100000:1.0:1788873728.756845:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050880 00000100:00100000:1.0:1788873728.756888:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051392 00000100:00100000:1.0:1788873728.756892:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051392 00000100:00100000:1.0:1788873728.756921:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051520 00000100:00100000:1.0:1788873728.756924:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051520 00000100:00100000:1.0:1788873728.756938:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050624 00000100:00100000:1.0:1788873728.756940:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050624 00000100:00100000:1.0:1788873728.756950:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051136 00000100:00100000:1.0:1788873728.756953:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051136 00000100:00100000:1.0:1788873728.756964:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051264 00000100:00100000:1.0:1788873728.756966:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051264 00000100:00100000:1.0:1788873728.756980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788873728.756988:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859050880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.757253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788873728.757260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859050752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.757310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859050752:12345-0@lo:400:kworker.0 Request processed in 50us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873728.757316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788873728.757341:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051648 00000100:00100000:2.0:1788873728.757346:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051648 00000100:00100000:2.0:1788873728.757384:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051776 00000100:00100000:2.0:1788873728.757387:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051776 00000100:00100000:2.0:1788873728.757410:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873728.757417:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859051648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873728.757619:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859050880:12345-0@lo:400:kworker.0 Request processed in 632us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.757627:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788873728.757642:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788873728.757649:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859051392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873728.757679:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859051392:12345-0@lo:400:kworker.0 Request processed in 31us (4944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.757685:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788873728.757695:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788873728.757700:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873728.757738:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859051520:12345-0@lo:400:kworker.0 Request processed in 38us (4827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.757743:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788873728.757764:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788873728.757770:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859050624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.758266:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859051648:12345-0@lo:400:kworker.0 Request processed in 847us (5190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873728.758273:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873728.758294:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788873728.758302:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859051776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873728.758496:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788873728.758506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859051136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873728.762097:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859050624:12345-0@lo:400:kworker.0 Request processed in 4307us (9115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.762113:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788873728.762154:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788873728.762167:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873728.762253:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859051264:12345-0@lo:400:kworker.0 Request processed in 91us (7820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873728.762259:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788873728.762284:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873728.762289:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873728.762292:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873728.764927:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859051008:0@lo:400:kworker.0 00010000:00080000:0.0:1788873728.764949:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886300 x1875769859051520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873728.764961:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859051520:0@lo:400:kworker.0 00000100:00100000:0.0:1788873728.764973:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859050880:0@lo:400:kworker.0 00000100:00100000:0.0:1788873728.764986:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859051392:0@lo:400:kworker.0 00000100:00100000:0.0:1788873728.765042:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859050752:0@lo:400:kworker.0 00010000:00080000:0.0:1788873728.765054:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343887b80 x1875769859051264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873728.765176:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.765735:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859051776:12345-0@lo:400:kworker.0 Request processed in 7431us (10439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873728.765745:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788873728.765943:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884380 x1875769859051776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873728.765955:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859051776:0@lo:400:kworker.0 00000100:00100000:0.0:1788873728.765971:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859050624:0@lo:400:kworker.0 00000100:00100000:3.0:1788873728.766276:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859051136:12345-0@lo:400:kworker.0 Request processed in 7770us (13244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.766286:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788873728.766317:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859050496 00000100:00100000:3.0:1788873728.766324:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859050496 00000100:00100000:3.0:1788873728.766366:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788873728.766375:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3635:x1875769859050496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873728.766942:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3635:x1875769859050496:12345-0@lo:400:kworker.0 Request processed in 567us (14146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.766950:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788873728.767344:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859050496:0@lo:400:kworker.0 00000100:00100000:0.0:1788873728.771394:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859051136:0@lo:400:kworker.0 00010000:00080000:1.0:1788873728.789687:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886680 x1875769859051648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873728.789781:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859051648:0@lo:400:kworker.0 00000100:00100000:2.0:1788873728.794659:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873728.798983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114688 00000100:00100000:3.0:1788873728.798996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114688 00000100:00100000:3.0:1788873728.801174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 251 00000100:00100000:3.0:1788873728.801190:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:6175:x1875769840114688:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873728.801226:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873728.801245:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9510 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873728.801274:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873728.801284:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873728.801294:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443c00, rc 0) 00000100:00100000:3.0:1788873728.801358:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840114688:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 173us (6710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.801365:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 251 00000100:00100000:0.0:1788873728.808437:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873728.809231:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114816 00000100:00100000:0.0:1788873728.809242:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114816 00000100:00100000:0.0:1788873728.809296:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 252 00000100:00100000:0.0:1788873728.809307:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840114816:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873728.811240:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840114816:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 140us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873728.811255:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 252 00000100:00100000:0.0:1788873728.832322:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873728.833428:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840114944 00000100:00100000:3.0:1788873728.834800:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840114944 00000100:00100000:3.0:1788873728.834874:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 253 00000100:00100000:3.0:1788873728.835012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840114944:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873728.835380:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6175:x1875769840114944:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 496us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.835390:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 253 00000100:00100000:0.0:1788873728.883688:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873728.887909:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115072 00000100:00100000:3.0:1788873728.887922:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115072 00000100:00100000:3.0:1788873728.887997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 254 00000100:00100000:3.0:1788873728.888008:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6716:x1875769840115072:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788873728.888172:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6716:x1875769840115072:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 165us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.888188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 254 00000100:00100000:0.0:1788873728.906172:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873728.906396:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115200 00000100:00100000:3.0:1788873728.906407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115200 00000100:00100000:3.0:1788873728.906481:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 255 00000100:00100000:3.0:1788873728.906492:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6716:x1875769840115200:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788873728.906645:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:6716:x1875769840115200:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 154us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873728.906653:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 255 10000000:01000000:0.0:1788873729.010168:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788873729.010178:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3341ecd800 from 4 10000000:01000000:0.0:1788873729.010183:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873729.010255:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873729.010267:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873729.010291:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873729.010317:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859051904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788873729.010388:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873729.010437:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.010594:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859051904 00000100:00100000:3.0:1788873729.010602:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859051904 00000100:00100000:3.0:1788873729.010655:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788873729.010665:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859051904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873729.010678:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873729.010691:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b6a8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.010725:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.010737:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.010746:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873729.010799:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859051904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.010805:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788873729.011303:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859051904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873729.011320:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.011330:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873729.011397:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.011439:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.011481:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.011833:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052032 00000100:00100000:3.0:1788873729.011840:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052032 00000100:00100000:3.0:1788873729.011873:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788873729.011879:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859052032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.012101:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859052032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.012109:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788873729.014329:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.014389:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.014468:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.019293:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488600 going to sleep for 11 seconds 00000100:00100000:0.0:1788873729.022801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052160 00000100:00100000:0.0:1788873729.022816:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052160 00000100:00100000:0.0:1788873729.023058:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788873729.023071:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859052160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873729.024271:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859052160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1197us (9798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873729.024282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788873729.024417:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.024689:0:10459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10459:1875769859052288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873729.024739:0:10459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.029371:0:10459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.030292:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052288 00000100:00100000:3.0:1788873729.030303:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052288 00000100:00100000:3.0:1788873729.030358:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788873729.030368:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10459:x1875769859052288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873729.030541:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10459:x1875769859052288:12345-0@lo:502:llog_process_th.0 Request processed in 174us (5801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.030549:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788873729.030774:0:10459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10459:1875769859052288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873729.031558:0:10459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873729.031692:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873729.031695:0:10459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788873729.031764:0:10459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3341ecd800 00000020:00000080:2.0:1788873729.031767:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788873729.032196:0:10459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343806300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10459:1875769859052416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873729.032450:0:10459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873729.032490:0:10459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82480 going to sleep for 11 seconds 00000100:00100000:0.0:1788873729.032541:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052416 00000100:00100000:0.0:1788873729.032549:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052416 00000100:00100000:0.0:1788873729.032780:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788873729.032790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10459:x1875769859052416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873729.033469:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:10459:x1875769859052416:12345-0@lo:502:llog_process_th.0 Request processed in 678us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873729.033478:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788873729.036800:0:10459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343806300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10459:1875769859052416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873729.039311:0:10459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873729.039333:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873729.039336:0:10459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788873729.039342:0:10459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788873729.044681:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788873729.044727:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873729.044740:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.044752:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873729.045099:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788873729.045102:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3476df3800 from 4 10000000:01000000:2.0:1788873729.045105:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788873729.045147:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873729.045155:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873729.045166:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873729.045191:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788873729.045275:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873729.045326:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873729.045388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052544 00000100:00100000:1.0:1788873729.045395:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052544 00000100:00100000:1.0:1788873729.045452:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788873729.045461:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859052544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873729.045485:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873729.045499:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b6b6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.045522:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.045533:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.045543:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfea600, rc 0) 00000100:00100000:1.0:1788873729.045597:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859052544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873729.045604:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788873729.045649:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343806680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873729.045661:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.045669:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873729.045890:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.045923:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.045951:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4883c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873729.046075:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052672 00000100:00100000:1.0:1788873729.046079:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052672 00000100:00100000:1.0:1788873729.046103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788873729.046108:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859052672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.046249:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859052672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873729.046255:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788873729.046284:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.046312:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.046350:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.046364:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4883c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873729.046374:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052800 00000100:00100000:1.0:1788873729.046378:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052800 00000100:00100000:1.0:1788873729.046394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788873729.046398:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859052800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.046480:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859052800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873729.046486:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788873729.046519:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859052800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873729.047790:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10462:1875769859052928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873729.047839:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.047874:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4883c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873729.047927:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859052928 00000100:00100000:2.0:1788873729.047940:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859052928 00000100:00100000:2.0:1788873729.048082:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788873729.048089:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10462:x1875769859052928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873729.048188:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10462:x1875769859052928:12345-0@lo:502:llog_process_th.0 Request processed in 99us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873729.048195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788873729.048366:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10462:1875769859052928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788873729.048391:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873729.048400:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873729.048402:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788873729.048409:0:10462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3476df3800 00000020:00000080:1.0:1788873729.048411:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788873729.048546:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10462:1875769859053056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873729.048596:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.048618:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053056 00000100:00100000:1.0:1788873729.048622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053056 00000100:00100000:1.0:1788873729.048646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788873729.048653:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10462:x1875769859053056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873729.048896:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:10462:x1875769859053056:12345-0@lo:502:llog_process_th.0 Request processed in 242us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873729.048917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788873729.049079:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873729.049094:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10462:1875769859053056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788873729.049115:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873729.049119:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873729.049121:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788873729.049124:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788873729.052078:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788873729.052117:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873729.052128:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052141:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873729.052152:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788873729.052155:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34651cb800 from 4 10000000:01000000:3.0:1788873729.052158:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788873729.052194:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052219:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052238:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873729.052265:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.052328:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873729.052378:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.052399:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053184 00000100:00100000:3.0:1788873729.052407:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053184 00000100:00100000:3.0:1788873729.052462:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788873729.052472:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859053184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873729.052483:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873729.052495:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b6c4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052515:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052525:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052533:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873729.052817:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859053184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.052825:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788873729.052876:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873729.052890:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.052907:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873729.053179:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.053230:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873729.053255:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.053268:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053312 00000100:00100000:3.0:1788873729.053271:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053312 00000100:00100000:3.0:1788873729.053293:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788873729.053298:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859053312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.053400:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859053312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.053406:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788873729.053435:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.053479:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.053517:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873729.053532:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.053544:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053440 00000100:00100000:3.0:1788873729.053547:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053440 00000100:00100000:3.0:1788873729.055148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788873729.055165:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859053440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.055331:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859053440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.055338:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788873729.056098:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.058871:0:10463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10463:1875769859053568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873729.059849:0:10463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873729.060220:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053568 00000100:00100000:3.0:1788873729.060228:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053568 00000100:00100000:3.0:1788873729.060275:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788873729.060284:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10463:x1875769859053568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873729.060404:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10463:x1875769859053568:12345-0@lo:502:llog_process_th.0 Request processed in 121us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.060412:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788873729.060474:0:10463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.060498:0:10463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10463:1875769859053568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873729.060529:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873729.060539:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873729.060541:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788873729.060548:0:10463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d34651cb800 00000020:00000080:3.0:1788873729.060550:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788873729.063926:0:10463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10463:1875769859053696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873729.065117:0:10463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873729.065167:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053696 00000100:00100000:3.0:1788873729.065174:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053696 00000100:00100000:3.0:1788873729.065237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788873729.065246:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10463:x1875769859053696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873729.065368:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:10463:x1875769859053696:12345-0@lo:502:llog_process_th.0 Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.065374:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788873729.065425:0:10463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.065457:0:10463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10463:1875769859053696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873729.065496:0:10463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873729.065503:0:10463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873729.065505:0:10463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788873729.065510:0:10463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788873729.072316:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788873729.072355:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788873729.072368:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873729.072395:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873729.072405:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788873729.072407:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34473c7800 from 4 10000000:01000000:2.0:1788873729.072410:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788873729.072460:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873729.072467:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873729.072476:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873729.072501:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343804380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788873729.073271:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873729.073761:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82480 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.081882:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053824 00000100:00100000:3.0:1788873729.081897:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053824 00000100:00100000:3.0:1788873729.082094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788873729.082105:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859053824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873729.082121:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873729.082141:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b6d2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.082168:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.082180:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.082190:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443200, rc 0) 00000100:00100000:3.0:1788873729.082291:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859053824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (9725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.082297:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788873729.082357:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343804380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873729.082375:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873729.082384:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873729.082486:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.082516:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873729.082543:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.082554:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859053952 00000100:00100000:3.0:1788873729.082557:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859053952 00000100:00100000:3.0:1788873729.085081:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788873729.085100:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859053952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.085302:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859053952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.085310:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788873729.086110:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859053952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873729.086164:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859054080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873729.086238:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873729.086274:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.087083:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054080 00000100:00100000:3.0:1788873729.087094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054080 00000100:00100000:3.0:1788873729.087140:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788873729.087149:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859054080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873729.087303:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859054080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.087311:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788873729.087370:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859054080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873729.089854:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10465:1875769859054208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873729.089946:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873729.090091:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442d80600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873729.093450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054208 00000100:00100000:3.0:1788873729.093467:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054208 00000100:00100000:3.0:1788873729.094985:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788873729.095004:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:10465:x1875769859054208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873729.095195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:10465:x1875769859054208:12345-0@lo:502:llog_process_th.0 Request processed in 198us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873729.095229:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788873729.095848:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10465:1875769859054208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873729.095889:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873729.095911:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873729.095914:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788873729.095921:0:10465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d34473c7800 00000020:00000080:2.0:1788873729.095924:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788873729.096020:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10465:1875769859054336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873729.096075:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873729.100320:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873729.101072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054336 00000100:00100000:1.0:1788873729.101081:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054336 00000100:00100000:1.0:1788873729.101128:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788873729.101138:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:10465:x1875769859054336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873729.101329:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:10465:x1875769859054336:12345-0@lo:502:llog_process_th.0 Request processed in 192us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873729.101337:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788873729.101455:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:10465:1875769859054336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788873729.101489:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873729.101496:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873729.101499:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788873729.101504:0:10465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788873729.101869:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788873729.102405:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873729.102416:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873729.102435:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873729.143089:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873729.265359:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859054464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873729.265426:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873729.265606:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873729.265614:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859054592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873729.265645:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873729.265711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054592 00000100:00100000:0.0:1788873729.265720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054592 00000100:00100000:0.0:1788873729.265770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788873729.265779:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859054592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873729.265810:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873729.265860:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859054592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873729.265867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788873729.265909:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859054592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873729.266256:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054464 00000100:00100000:2.0:1788873729.266271:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054464 00000100:00100000:2.0:1788873729.266304:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788873729.266311:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859054464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788873729.266330:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873729.266379:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859054464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873729.266385:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788873729.269598:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475e59880 x1875769859054464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873729.269627:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859054464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873729.270296:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873729.270312:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859054720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873729.270372:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873729.270422:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054720 00000100:00100000:0.0:1788873729.270428:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054720 00000100:00100000:0.0:1788873729.270500:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788873729.270508:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859054720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873729.270526:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873729.270567:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859054720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873729.270575:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788873729.270609:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abc380 x1875769859054720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873729.270623:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859054720:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788873730.158500:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873731.188759:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873731.823479:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859054848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873731.823584:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873731.823643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054848 00000100:00100000:3.0:1788873731.823664:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054848 00000100:00100000:3.0:1788873731.823734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788873731.823745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859054848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873731.823783:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788873731.823859:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859054848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873731.823866:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788873731.823930:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859054848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788873732.206309:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873733.235686:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873733.358636:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873733.358664:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859054976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873733.358773:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873733.358881:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859054976 00000100:00100000:0.0:1788873733.358891:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859054976 00000100:00100000:0.0:1788873733.358949:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873733.358959:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859054976:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788873733.359007:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788873733.359089:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788873733.359195:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427d1c00 x1875769859054976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873733.359230:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859054976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873733.359272:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859054976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873733.359280:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873733.359307:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873733.359315:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859055104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873733.359343:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873733.359434:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055104 00000100:00100000:3.0:1788873733.359440:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055104 00000100:00100000:3.0:1788873733.359482:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788873733.359489:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859055104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873733.359563:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788873733.359596:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873733.359616:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859055104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873733.359623:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788873733.359649:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f354a80 x1875769859055104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873733.359663:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859055104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873733.773883:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873733.774020:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873733.774054:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873733.774072:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873733.774104:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873733.774133:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115840 00000100:00100000:0.0:1788873733.774143:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115840 00000100:00100000:0.0:1788873733.774223:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115712 00000100:00100000:0.0:1788873733.774227:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115712 00000100:00100000:0.0:1788873733.774256:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:0.0:1788873733.774266:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840115840:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873733.774335:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840115840:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 70us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873733.774343:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:0.0:1788873733.774361:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:0.0:1788873733.774368:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840115712:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873733.774391:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840115712:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873733.774409:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00080000:0.0:1788873733.774427:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788873733.774431:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873733.774714:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115584 00000100:00100000:3.0:1788873733.774719:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115584 00000100:00100000:0.0:1788873733.776021:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115456 00000100:00100000:0.0:1788873733.776031:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115456 00000100:00100000:0.0:1788873733.776079:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:0.0:1788873733.776089:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840115456:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873733.776144:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840115456:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 57us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873733.776151:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:1.0:1788873733.777022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115328 00000100:00100000:1.0:1788873733.777037:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115328 00000100:00100000:1.0:1788873733.777075:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 276 00000100:00100000:1.0:1788873733.777083:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840115328:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873733.777123:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840115328:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 41us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.777130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 276 00000100:00100000:3.0:1788873733.779096:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 82 00000100:00100000:3.0:1788873733.779114:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840115584:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873733.779198:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840115584:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 88us (5176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873733.779219:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 82 00000100:00080000:2.0:1788873733.787334:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788873733.787343:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873733.879453:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873733.879584:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873733.879611:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859055360:0@lo:400:kworker.0 00000100:00100000:3.0:1788873733.879688:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873733.879816:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055360 00000100:00100000:2.0:1788873733.879823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055360 00000100:00100000:2.0:1788873733.879884:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788873733.880000:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859055360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873733.880062:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859055360:12345-0@lo:400:kworker.0 Request processed in 64us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873733.880069:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788873733.880180:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859055360:0@lo:400:kworker.0 00000100:00100000:0.0:1788873733.880307:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859055232:0@lo:400:kworker.0 00000100:00100000:0.0:1788873733.880351:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.880716:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859055744:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.880749:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.880769:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859056256:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.880790:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.880808:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788873733.880813:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859055872:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.880834:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.880850:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859056384:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.880874:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.881006:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859055488:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881032:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.881052:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859056000:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.881102:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859056512:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881123:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.881142:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788873733.881147:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859055616:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881168:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.881184:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859056128:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881239:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873733.881271:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055744 00000100:00100000:1.0:1788873733.881276:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055744 00000100:00100000:1.0:1788873733.881312:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055488 00000100:00100000:1.0:1788873733.881315:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055488 00000100:00100000:1.0:1788873733.881327:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788873733.881334:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859055744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881374:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859055744:12345-0@lo:400:kworker.0 Request processed in 40us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881381:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788873733.881393:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788873733.881412:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859055488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881442:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859055488:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881447:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788873733.881465:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056256 00000100:00100000:1.0:1788873733.881469:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056256 00000100:00100000:1.0:1788873733.881495:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055872 00000100:00100000:1.0:1788873733.881498:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055872 00000100:00100000:1.0:1788873733.881509:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056000 00000100:00100000:1.0:1788873733.881511:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056000 00000100:00100000:1.0:1788873733.881521:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055616 00000100:00100000:1.0:1788873733.881524:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055616 00000100:00100000:1.0:1788873733.881533:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056128 00000100:00100000:1.0:1788873733.881535:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056128 00000100:00100000:1.0:1788873733.881547:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788873733.881552:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859056256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881582:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859056256:12345-0@lo:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881599:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788873733.881611:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788873733.881616:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881645:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859055872:12345-0@lo:400:kworker.0 Request processed in 29us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881650:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788873733.881660:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788873733.881665:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859056000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881687:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859056000:12345-0@lo:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881693:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788873733.881702:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788873733.881707:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859055616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881731:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859055616:12345-0@lo:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881736:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788873733.881745:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788873733.881750:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859056128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881775:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859056128:12345-0@lo:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881780:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788873733.881800:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056384 00000100:00100000:1.0:1788873733.881804:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056384 00000100:00100000:1.0:1788873733.881828:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056512 00000100:00100000:1.0:1788873733.881831:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056512 00000100:00100000:1.0:1788873733.881856:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873733.881862:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881913:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859056384:12345-0@lo:400:kworker.0 Request processed in 51us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881920:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873733.881931:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788873733.881936:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859056512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.881962:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859056512:12345-0@lo:400:kworker.0 Request processed in 26us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873733.881967:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788873733.881998:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873733.882002:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873733.882004:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873733.882043:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859055872:0@lo:400:kworker.0 00010000:00080000:1.0:1788873733.882057:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334401aa00 x1875769859056384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873733.882067:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859056384:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.882076:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859055744:0@lo:400:kworker.0 00010000:00080000:1.0:1788873733.882085:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344019180 x1875769859056256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873733.882094:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859056256:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.882127:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859055616:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.882136:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859056128:0@lo:400:kworker.0 00000100:00100000:1.0:1788873733.882156:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859055488:0@lo:400:kworker.0 00010000:00080000:1.0:1788873733.882164:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427d3800 x1875769859056000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873733.882172:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859056000:0@lo:400:kworker.0 00010000:00080000:1.0:1788873733.882180:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344019c00 x1875769859056512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873733.882187:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859056512:0@lo:400:kworker.0 00000100:00100000:3.0:1788873733.882589:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859055232 00000100:00100000:3.0:1788873733.882594:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859055232 00000100:00100000:3.0:1788873733.882634:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788873733.882642:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859055232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873733.882698:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859055232:12345-0@lo:400:kworker.0 Request processed in 57us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873733.882704:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788873733.882745:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859055232:0@lo:400:kworker.0 00010000:00010000:0.0:1788873734.254838:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873734.384553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859056640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873734.384588:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859056768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873734.384621:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873734.384621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873734.384767:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859056896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873734.387339:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056768 00000100:00100000:2.0:1788873734.387356:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056768 00000100:00100000:2.0:1788873734.387424:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788873734.387434:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859056768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788873734.387468:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873734.387697:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056640 00000100:00100000:0.0:1788873734.387703:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056640 00000100:00100000:0.0:1788873734.387736:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788873734.387743:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859056640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873734.387768:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873734.387824:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859056640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873734.387831:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788873734.387901:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859056640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873734.394661:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873734.394741:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859056896 00000100:00100000:3.0:1788873734.394751:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859056896 00000100:00100000:3.0:1788873734.394791:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873734.394800:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859056896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873734.394826:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873734.394883:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859056896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873734.394904:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788873734.394947:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343804e00 x1875769859056896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873734.394968:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859056896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873734.397354:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859056768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9913us (12724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873734.397367:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788873734.398695:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344019c00 x1875769859056768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873734.398721:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859056768:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788873734.463669:0:10691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788873735.279049:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873736.304559:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873736.942687:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859057024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873736.942823:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873736.943103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057024 00000100:00100000:3.0:1788873736.943114:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057024 00000100:00100000:3.0:1788873736.943183:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788873736.943194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859057024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873736.943285:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788873736.943357:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859057024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873736.943365:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788873736.943602:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859057024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788873737.332711:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873738.352434:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873738.478461:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859057152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873738.478565:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873738.479108:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873738.479149:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873738.480345:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057152 00000100:00100000:3.0:1788873738.480373:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057152 00000100:00100000:3.0:1788873738.480458:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057280 00000100:00100000:3.0:1788873738.480462:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057280 00000100:00100000:3.0:1788873738.480488:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873738.480500:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859057152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873738.480540:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873738.480643:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859057152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873738.480651:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873738.480672:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788873738.480679:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859057280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873738.480689:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873738.480720:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859057280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873738.480726:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788873738.480778:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344019c00 x1875769859057152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873738.480819:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859057152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788873738.481001:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788873738.481036:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abdf80 x1875769859057280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873738.481051:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873738.893638:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873738.893685:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873738.893703:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873738.893722:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873738.893749:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873738.894233:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840115968 00000100:00100000:1.0:1788873738.894248:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840115968 00000100:00100000:0.0:1788873738.894282:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116224 00000100:00100000:0.0:1788873738.894286:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116224 00000100:00100000:1.0:1788873738.894326:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 278 00000100:00100000:0.0:1788873738.894329:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116096 00000100:00100000:0.0:1788873738.894332:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116096 00000100:00100000:1.0:1788873738.894338:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2399:x1875769840115968:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873738.894363:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 89 00000100:00100000:0.0:1788873738.894370:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840116224:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873738.894437:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840116224:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 67us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873738.894446:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 89 00000100:00100000:0.0:1788873738.894531:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00100000:0.0:1788873738.894540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840116096:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873738.898046:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2399:x1875769840115968:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 3690us (4403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873738.898066:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 278 00000100:00100000:1.0:1788873738.898152:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116352 00000100:00100000:1.0:1788873738.898171:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116352 00000100:00100000:1.0:1788873738.898247:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116480 00000100:00100000:1.0:1788873738.898251:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116480 00000100:00100000:1.0:1788873738.898276:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:1.0:1788873738.898285:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2397:x1875769840116352:12345-192.168.202.20@tcp:9:kworker.0 00000020:00000080:1.0:1788873738.898327:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b5eb 00000100:00080000:1.0:1788873738.898338:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d3341ead000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788873738.898385:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788873738.898410:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788873738.898601:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+2:2397:x1875769840116352:12345-192.168.202.20@tcp:9:kworker.0 Request processed in 316us (4877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873738.898609:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:1.0:1788873738.898623:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:1.0:1788873738.898630:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d344ff48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2397:x1875769840116480:12345-192.168.202.20@tcp:9:kworker.0 00000020:00000080:1.0:1788873738.898644:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b5f2 00000100:00080000:1.0:1788873738.898651:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d334397c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788873738.898678:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788873738.898717:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840116096:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 4176us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873738.898729:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00080000:0.0:1788873738.898768:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873738.898772:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788873738.898774:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873738.898778:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873738.899658:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d344ff48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+2:2397:x1875769840116480:12345-192.168.202.20@tcp:9:kworker.0 Request processed in 1020us (5899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873738.899669:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00010000:00010000:1.0:1788873738.900866:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873739.000473:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859057792:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000542:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000600:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859058304:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000620:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000644:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788873739.000650:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859057408:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000681:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000704:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859057920:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000728:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000749:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859058432:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000782:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000814:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859057536:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000840:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000858:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859058048:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000875:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000889:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000908:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000924:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788873739.000929:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859057664:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000946:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000960:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859058176:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.000988:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.000998:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859058688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001014:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873739.001044:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057792 00000100:00100000:2.0:1788873739.001051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057792 00000100:00100000:2.0:1788873739.001086:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058304 00000100:00100000:2.0:1788873739.001089:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058304 00000100:00100000:2.0:1788873739.001111:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058432 00000100:00100000:2.0:1788873739.001114:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058432 00000100:00100000:2.0:1788873739.001126:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057536 00000100:00100000:2.0:1788873739.001129:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057536 00000100:00100000:2.0:1788873739.001138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058048 00000100:00100000:2.0:1788873739.001140:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058048 00000100:00100000:2.0:1788873739.001152:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058176 00000100:00100000:2.0:1788873739.001155:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058176 00000100:00100000:2.0:1788873739.001170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788873739.001178:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859057792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859057792:12345-0@lo:400:kworker.0 Request processed in 81us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788873739.001293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788873739.001300:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859058304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859058304:12345-0@lo:400:kworker.0 Request processed in 28us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001332:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788873739.001344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788873739.001364:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859058432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001390:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859058432:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001402:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788873739.001415:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788873739.001421:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859057536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859057536:12345-0@lo:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788873739.001470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788873739.001475:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859058048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859058048:12345-0@lo:400:kworker.0 Request processed in 26us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788873739.001517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788873739.001522:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859058176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001545:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859058176:12345-0@lo:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788873739.001568:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057920 00000100:00100000:2.0:1788873739.001572:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057920 00000100:00100000:2.0:1788873739.001596:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057664 00000100:00100000:2.0:1788873739.001600:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057664 00000100:00100000:2.0:1788873739.001612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788873739.001618:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859057920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001649:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859057920:12345-0@lo:400:kworker.0 Request processed in 31us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001655:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788873739.001675:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788873739.001681:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859057664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001710:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859057664:12345-0@lo:400:kworker.0 Request processed in 29us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001715:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788873739.001746:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058560 00000100:00100000:2.0:1788873739.001749:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058560 00000100:00100000:2.0:1788873739.001775:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058688 00000100:00100000:2.0:1788873739.001778:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058688 00000100:00100000:2.0:1788873739.001797:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788873739.001803:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859058560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001831:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859058560:12345-0@lo:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001836:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788873739.001847:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788873739.001851:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859058688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.001872:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859058688:12345-0@lo:400:kworker.0 Request processed in 20us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.001877:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788873739.001900:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873739.001905:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873739.001907:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873739.001939:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859057664:0@lo:400:kworker.0 00010000:00080000:2.0:1788873739.001952:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343807800 x1875769859058176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873739.001962:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859058176:0@lo:400:kworker.0 00010000:00080000:2.0:1788873739.001982:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343805500 x1875769859058688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873739.001990:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859058688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.002000:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859057536:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.002009:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859058048:0@lo:400:kworker.0 00010000:00080000:2.0:1788873739.002018:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343804e00 x1875769859058560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873739.002025:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.002067:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859057920:0@lo:400:kworker.0 00010000:00080000:2.0:1788873739.002077:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343804a80 x1875769859058432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873739.002085:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859058432:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.002097:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859057792:0@lo:400:kworker.0 00000100:00100000:2.0:1788873739.002107:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859058304:0@lo:400:kworker.0 00000100:00100000:1.0:1788873739.011413:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859057408 00000100:00100000:1.0:1788873739.011430:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859057408 00000100:00100000:1.0:1788873739.011499:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788873739.011511:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859057408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873739.011707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859057408:12345-0@lo:400:kworker.0 Request processed in 197us (11024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873739.011715:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788873739.012505:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859057408:0@lo:400:kworker.0 00010000:00010000:0.0:1788873739.376570:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873739.502376:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859058816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873739.502453:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873739.502682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058816 00000100:00100000:0.0:1788873739.502690:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058816 00000100:00100000:0.0:1788873739.502739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788873739.502749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859058816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873739.502796:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873739.502846:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859058816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873739.502854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788873739.502902:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859058816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873739.503729:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859058944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873739.503779:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873739.503879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859059072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873739.503904:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873739.504111:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859058944 00000100:00100000:3.0:1788873739.504118:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859058944 00000100:00100000:3.0:1788873739.504169:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788873739.504178:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859058944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873739.504217:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873739.504260:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859058944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873739.504267:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788873739.504300:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355180 x1875769859058944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873739.504315:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859058944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873739.504469:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059072 00000100:00100000:2.0:1788873739.504536:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059072 00000100:00100000:2.0:1788873739.504573:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788873739.504580:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859059072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788873739.504592:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873739.504742:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859059072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873739.504761:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788873739.504843:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abea00 x1875769859059072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873739.504858:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859059072:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788873740.143071:0:10935:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing yml_node 00010000:00010000:2.0:1788873740.403922:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873741.422476:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873742.063161:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873742.063197:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859059200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873742.063334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873742.063485:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059200 00000100:00100000:0.0:1788873742.063497:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059200 00000100:00100000:0.0:1788873742.063584:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788873742.063599:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859059200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873742.063648:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873742.063722:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859059200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873742.063730:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788873742.063873:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859059200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873742.446534:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873743.475194:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873743.598421:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873743.598452:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859059328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873743.598550:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873743.598632:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059328 00000100:00100000:0.0:1788873743.598642:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059328 00000100:00100000:0.0:1788873743.598713:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873743.598755:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859059328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873743.598805:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873743.598860:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859059328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873743.598868:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788873743.598894:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788873743.598932:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abed80 x1875769859059328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873743.598955:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859059328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873743.602641:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859059456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873743.602741:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873743.603948:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059456 00000100:00100000:2.0:1788873743.603968:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059456 00000100:00100000:2.0:1788873743.604253:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788873743.604266:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859059456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873743.604313:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873743.604411:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859059456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873743.604419:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788873743.604504:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc0380 x1875769859059456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873743.604530:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859059456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788873743.604580:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873744.011478:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873744.011539:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873744.011684:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116608 00000100:00100000:1.0:1788873744.011700:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116608 00000100:00100000:1.0:1788873744.011787:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 280 00000100:00100000:1.0:1788873744.011809:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840116608:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873744.011906:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840116608:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 99us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873744.011914:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 280 00000100:00100000:0.0:1788873744.012280:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873744.012397:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116864 00000100:00100000:2.0:1788873744.012404:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116864 00000100:00100000:2.0:1788873744.012472:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116736 00000100:00100000:2.0:1788873744.012477:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116736 00000100:00100000:2.0:1788873744.012504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 97 00000100:00100000:2.0:1788873744.012513:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840116864:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873744.012559:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840116864:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 48us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873744.012567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 97 00000100:00100000:2.0:1788873744.012605:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 98 00000100:00100000:2.0:1788873744.012613:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840116736:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873744.012663:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840116736:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 52us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873744.012670:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 98 00000100:00080000:0.0:1788873744.013605:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873744.013612:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873744.110482:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859059584:0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.110592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873744.110720:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059584 00000100:00100000:0.0:1788873744.110730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059584 00000100:00100000:0.0:1788873744.110813:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788873744.110826:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859059584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.114693:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859059584:12345-0@lo:400:kworker.0 Request processed in 3852us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.114714:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788873744.114965:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859059584:0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.115059:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873744.115076:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859059712:0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.115155:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115476:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859060224:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115511:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115534:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859060736:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115558:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115579:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788873744.115585:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859060096:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115611:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115630:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859060608:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115669:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859061120:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115688:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115713:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859059840:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115734:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115750:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859060352:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.115770:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.115787:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859060864:0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.115919:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059712 00000100:00100000:0.0:1788873744.115929:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059712 00000100:00100000:0.0:1788873744.116051:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060224 00000100:00100000:0.0:1788873744.116055:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060224 00000100:00100000:0.0:1788873744.116086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060736 00000100:00100000:0.0:1788873744.116089:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060736 00000100:00100000:0.0:1788873744.116101:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060352 00000100:00100000:0.0:1788873744.116113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060352 00000100:00100000:0.0:1788873744.116133:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788873744.116141:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859059712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.116193:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859059712:12345-0@lo:400:kworker.0 Request processed in 53us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.116200:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788873744.116230:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788873744.116236:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859060224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.116263:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859060224:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.116270:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788873744.116278:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788873744.116283:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859060736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.116316:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859060736:12345-0@lo:400:kworker.0 Request processed in 33us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.116322:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788873744.116331:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873744.116337:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859060352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.116360:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859060352:12345-0@lo:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.116365:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788873744.116393:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873744.116398:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873744.116469:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788873744.116519:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc1880 x1875769859060352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873744.116536:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859060352:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.116561:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788873744.116570:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859059968:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.116595:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.116607:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859060480:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.116629:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.116650:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859060992:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.116671:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.116704:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060864 00000100:00100000:2.0:1788873744.116708:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060864 00000100:00100000:2.0:1788873744.116737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059968 00000100:00100000:2.0:1788873744.116740:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059968 00000100:00100000:2.0:1788873744.116753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788873744.116758:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859060864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.116879:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788873744.116887:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859059968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873744.116916:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859059968:12345-0@lo:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.116930:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788873744.117091:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859059712:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.117913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859060864:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873744.117929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788873744.118126:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060096 00000100:00100000:3.0:1788873744.118134:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060096 00000100:00100000:3.0:1788873744.118178:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859059840 00000100:00100000:3.0:1788873744.118181:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859059840 00000100:00100000:3.0:1788873744.118197:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788873744.118227:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.118318:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859060096:12345-0@lo:400:kworker.0 Request processed in 114us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.118326:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788873744.118337:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788873744.118343:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.118369:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859059840:12345-0@lo:400:kworker.0 Request processed in 26us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.118374:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788873744.118390:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060608 00000100:00100000:3.0:1788873744.118393:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060608 00000100:00100000:3.0:1788873744.118410:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061120 00000100:00100000:3.0:1788873744.118412:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061120 00000100:00100000:3.0:1788873744.118425:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060480 00000100:00100000:3.0:1788873744.118427:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060480 00000100:00100000:3.0:1788873744.118436:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859060992 00000100:00100000:3.0:1788873744.118438:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859060992 00000100:00100000:3.0:1788873744.118449:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873744.118455:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.118483:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859060608:12345-0@lo:400:kworker.0 Request processed in 28us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.118500:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873744.118509:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873744.118514:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859061120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.118544:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859061120:12345-0@lo:400:kworker.0 Request processed in 29us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.118550:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873744.118559:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788873744.118565:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.118592:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859060480:12345-0@lo:400:kworker.0 Request processed in 28us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.118598:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788873744.118608:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788873744.118614:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873744.118641:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859060992:12345-0@lo:400:kworker.0 Request processed in 27us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.118646:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788873744.118968:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873744.118973:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873744.119424:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859060096:0@lo:400:kworker.0 00010000:00080000:2.0:1788873744.119443:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc2d80 x1875769859060608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873744.119455:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859060608:0@lo:400:kworker.0 00010000:00080000:2.0:1788873744.119468:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343807480 x1875769859061120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873744.119477:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859061120:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.119506:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859060224:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.119521:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859060736:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.119579:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859059968:0@lo:400:kworker.0 00010000:00080000:2.0:1788873744.119594:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc0700 x1875769859060480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873744.119603:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859060480:0@lo:400:kworker.0 00010000:00080000:2.0:1788873744.119615:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc0380 x1875769859060992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873744.119623:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859060992:0@lo:400:kworker.0 00000100:00100000:2.0:1788873744.119635:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859059840:0@lo:400:kworker.0 00010000:00080000:2.0:1788873744.119649:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc3800 x1875769859060864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873744.119656:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859060864:0@lo:400:kworker.0 00000001:02000400:1.0:1788873744.218320:0:11118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:3.0:1788873744.500550:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873744.626344:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859061248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873744.626443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873744.626539:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873744.626548:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873744.626644:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873744.626934:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061248 00000100:00100000:0.0:1788873744.626944:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061248 00000100:00100000:0.0:1788873744.627013:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873744.627025:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859061248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873744.627067:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873744.627131:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859061248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873744.627138:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788873744.627189:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344018e00 x1875769859061248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873744.627243:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859061248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873744.627565:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061376 00000100:00100000:3.0:1788873744.627720:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061376 00000100:00100000:3.0:1788873744.627767:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788873744.627776:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859061376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873744.627917:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873744.627980:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859061376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 205us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873744.627988:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788873744.628035:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859061504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873744.628074:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873744.628130:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873744.628250:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061504 00000100:00100000:2.0:1788873744.628255:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061504 00000100:00100000:2.0:1788873744.628288:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788873744.628305:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859061504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873744.628327:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873744.628362:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859061504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873744.628368:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788873744.628650:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f357480 x1875769859061504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873744.628665:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859061504:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788873745.142085:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:1.0:1788873745.142096:0:9507:0:(genops.c:885:class_export_put()) final put ffff9d334397e000/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:0.0:1788873745.142406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334397e000/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-OST0001 00000020:00000080:0.0:1788873745.142493:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d334397c800 for lustre-OST0001 00000001:00100000:3.0:1788873745.143089:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:3.0:1788873745.143098:0:8420:0:(genops.c:885:class_export_put()) final put ffff9d3341eaf000/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:0.0:1788873745.144370:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341eaf000/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-OST0000 00000020:00000080:0.0:1788873745.144441:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3341ead000 for lustre-OST0000 00010000:00010000:3.0:1788873745.522044:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873746.542843:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873747.184432:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873747.184458:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859061632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873747.184533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873747.184606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061632 00000100:00100000:0.0:1788873747.184615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061632 00000100:00100000:0.0:1788873747.184664:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788873747.184672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859061632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873747.184707:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873747.184761:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859061632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873747.184769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788873747.184815:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859061632:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788873747.188899:0:11216:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:2.0:1788873747.566529:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873748.591122:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873748.718514:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859061760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873748.718641:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873748.718752:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061760 00000100:00100000:3.0:1788873748.718766:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061760 00000100:00100000:3.0:1788873748.718847:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788873748.718859:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859061760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873748.718896:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873748.718999:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859061760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873748.719008:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788873748.719140:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873748.719156:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859061888:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788873748.719200:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abea00 x1875769859061760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873748.719264:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873748.719275:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859061760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873748.719331:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859061888 00000100:00100000:2.0:1788873748.719340:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859061888 00000100:00100000:2.0:1788873748.719401:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788873748.719411:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859061888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873748.719437:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873748.719491:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859061888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873748.719499:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788873748.719569:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc0700 x1875769859061888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873748.719586:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859061888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788873748.719772:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873749.131392:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873749.131456:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873749.131542:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873749.131594:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840116992 00000100:00100000:3.0:1788873749.131603:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840116992 00000100:00100000:3.0:1788873749.131681:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 282 00000100:00100000:3.0:1788873749.131693:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2398:x1875769840116992:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873749.131765:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2398:x1875769840116992:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 74us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.131772:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 282 00000100:00100000:0.0:1788873749.151783:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117248 00000100:00100000:0.0:1788873749.151802:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117248 00000100:00100000:0.0:1788873749.151895:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117120 00000100:00100000:0.0:1788873749.151900:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117120 00000100:00100000:0.0:1788873749.151941:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 105 00000100:00100000:0.0:1788873749.151955:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840117248:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873749.152040:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840117248:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 90us (20584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.152048:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 105 00000100:00100000:0.0:1788873749.152067:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 106 00000100:00100000:0.0:1788873749.152073:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840117120:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873749.152099:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840117120:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 26us (20556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.152105:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 106 00000100:00080000:1.0:1788873749.152428:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873749.152433:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873749.230620:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859062144:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.230747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.230840:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859062656:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.230864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.230887:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859063168:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.230907:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.230951:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788873749.230957:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859062272:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.230987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.231007:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859062784:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231030:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.231048:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859063296:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.231115:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062144 00000100:00100000:0.0:1788873749.231126:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062144 00000100:00100000:0.0:1788873749.231184:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062656 00000100:00100000:0.0:1788873749.231188:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062656 00000100:00100000:0.0:1788873749.231266:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063168 00000100:00100000:0.0:1788873749.231269:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063168 00000100:00100000:0.0:1788873749.231284:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062784 00000100:00100000:0.0:1788873749.231287:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062784 00000100:00100000:0.0:1788873749.231299:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063296 00000100:00100000:0.0:1788873749.231301:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063296 00000100:00100000:0.0:1788873749.231319:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873749.231330:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859062144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231398:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859062144:12345-0@lo:400:kworker.0 Request processed in 70us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.231407:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873749.231433:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788873749.231439:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859062656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231468:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859062656:12345-0@lo:400:kworker.0 Request processed in 30us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.231473:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788873749.231484:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788873749.231500:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859063168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231528:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859063168:12345-0@lo:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.231534:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788873749.231546:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788873749.231553:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859062784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231578:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859062784:12345-0@lo:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.231584:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788873749.231592:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788873749.231598:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859063296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231623:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859063296:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.231629:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788873749.231654:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062272 00000100:00100000:0.0:1788873749.231658:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062272 00000100:00100000:0.0:1788873749.231683:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788873749.231688:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859062272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231719:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859062272:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.231725:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788873749.231740:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873749.231744:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873749.231781:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859062272:0@lo:400:kworker.0 00010000:00080000:0.0:1788873749.231796:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886680 x1875769859062784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873749.231820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859062784:0@lo:400:kworker.0 00010000:00080000:0.0:1788873749.231833:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343887b80 x1875769859063296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873749.231842:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859063296:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231853:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859062144:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231862:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859062656:0@lo:400:kworker.0 00000100:00100000:0.0:1788873749.231873:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859063168:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232192:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859062400:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232285:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232320:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859062912:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232347:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232369:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859063424:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232390:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232422:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788873749.232429:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859062016:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232457:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232479:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859062528:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232500:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232516:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859063040:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232534:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232552:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859063552:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232569:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873749.232596:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062400 00000100:00100000:3.0:1788873749.232601:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062400 00000100:00100000:3.0:1788873749.232643:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788873749.232651:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859062400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232709:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859062400:12345-0@lo:400:kworker.0 Request processed in 58us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.232717:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788873749.232737:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062912 00000100:00100000:3.0:1788873749.232741:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062912 00000100:00100000:3.0:1788873749.232759:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063424 00000100:00100000:3.0:1788873749.232761:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063424 00000100:00100000:3.0:1788873749.232780:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063040 00000100:00100000:3.0:1788873749.232789:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063040 00000100:00100000:3.0:1788873749.232801:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063552 00000100:00100000:3.0:1788873749.232814:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063552 00000100:00100000:3.0:1788873749.232829:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788873749.232835:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859062912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232867:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859062912:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.232873:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788873749.232883:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788873749.232888:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859063424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232912:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859063424:12345-0@lo:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.232918:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788873749.232928:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788873749.232934:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859063040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.232960:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859063040:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.232966:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788873749.232976:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788873749.232981:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859063552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.233007:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859063552:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.233013:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788873749.233038:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062016 00000100:00100000:3.0:1788873749.233042:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062016 00000100:00100000:3.0:1788873749.233072:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788873749.233078:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859062016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.233121:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859062016:12345-0@lo:400:kworker.0 Request processed in 43us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.233128:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788873749.233157:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859062528 00000100:00100000:3.0:1788873749.233161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859062528 00000100:00100000:3.0:1788873749.233187:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788873749.233193:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859062528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.233262:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859062528:12345-0@lo:400:kworker.0 Request processed in 59us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873749.233269:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788873749.233299:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873749.233335:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859062016:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.233350:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859062528:0@lo:400:kworker.0 00010000:00080000:3.0:1788873749.233364:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884000 x1875769859063040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873749.233377:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859063040:0@lo:400:kworker.0 00010000:00080000:3.0:1788873749.233388:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886d80 x1875769859063552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873749.233396:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859063552:0@lo:400:kworker.0 00000100:00100000:3.0:1788873749.233409:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859062400:0@lo:400:kworker.0 00010000:00080000:3.0:1788873749.233420:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885c00 x1875769859062912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873749.233428:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859062912:0@lo:400:kworker.0 00010000:00080000:3.0:1788873749.233447:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343887800 x1875769859063424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873749.233455:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859063424:0@lo:400:kworker.0 00010000:00010000:3.0:1788873749.616572:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873749.743021:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859063680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873749.743133:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873749.743340:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063680 00000100:00100000:1.0:1788873749.743354:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063680 00000100:00100000:1.0:1788873749.743428:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788873749.743441:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859063680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873749.743489:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873749.743562:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859063680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873749.743570:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788873749.743682:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334401ad80 x1875769859063680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873749.743707:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859063680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873749.743947:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873749.743956:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873749.744001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.744048:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063808 00000100:00100000:0.0:1788873749.744055:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063808 00000100:00100000:2.0:1788873749.744099:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859063936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873749.744113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788873749.744125:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859063808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873749.744162:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873749.747413:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859063808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.747467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788873749.747620:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873749.753524:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873749.753603:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859063936 00000100:00100000:0.0:1788873749.753627:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859063936 00000100:00100000:0.0:1788873749.753708:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788873749.753719:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859063936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873749.753761:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873749.753862:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859063936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (9658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873749.753870:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788873749.754111:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bc0000 x1875769859063936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873749.754141:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859063936:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788873750.048992:0:11313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:3.0:1788873750.641164:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873751.671297:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788873752.206824:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 09:22:30 EDT 2026 00000100:00100000:2.0:1788873752.302402:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859064064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873752.302506:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873752.302808:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064064 00000100:00100000:0.0:1788873752.302821:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064064 00000100:00100000:0.0:1788873752.302890:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788873752.302902:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859064064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873752.302952:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873752.303022:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859064064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873752.303029:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788873752.303091:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859064064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873752.686486:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873753.722081:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873753.838495:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859064192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873753.838598:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873753.838702:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064192 00000100:00100000:1.0:1788873753.838712:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064192 00000100:00100000:1.0:1788873753.838778:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788873753.838788:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859064192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873753.838827:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873753.838880:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859064192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873753.838887:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788873753.838912:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873753.838951:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344018000 x1875769859064192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873753.838973:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859064192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873753.839153:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859064320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873753.839183:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873753.844771:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064320 00000100:00100000:0.0:1788873753.844789:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064320 00000100:00100000:0.0:1788873753.844888:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788873753.844901:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859064320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873753.844942:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873753.845080:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859064320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (5895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873753.845088:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788873753.845169:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873753.845256:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5a680 x1875769859064320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873753.845282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859064320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873754.248338:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873754.248398:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873754.248458:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117504 00000100:00100000:3.0:1788873754.248471:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117504 00000100:00100000:3.0:1788873754.248551:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 113 00000100:00100000:3.0:1788873754.248566:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840117504:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873754.248666:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840117504:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 104us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873754.248675:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 113 00000100:00080000:3.0:1788873754.248715:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873754.249479:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117376 00000100:00100000:0.0:1788873754.249490:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117376 00000100:00100000:0.0:1788873754.249547:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 284 00000100:00100000:0.0:1788873754.249557:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2399:x1875769840117376:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873754.249613:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2399:x1875769840117376:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 57us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873754.249620:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 284 00000100:00100000:3.0:1788873754.260036:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873754.260151:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117632 00000100:00100000:1.0:1788873754.260166:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117632 00000100:00100000:1.0:1788873754.260315:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:1.0:1788873754.260328:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840117632:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873754.260431:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840117632:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873754.260438:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00080000:3.0:1788873754.260671:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873754.351113:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859064576:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351322:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859065088:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351347:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351376:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859065600:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351399:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351428:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788873754.351434:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859064448:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351479:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351504:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859064960:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351533:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351552:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859065472:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351577:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351596:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859065984:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351619:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.351660:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064576 00000100:00100000:2.0:1788873754.351670:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064576 00000100:00100000:2.0:1788873754.351727:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065088 00000100:00100000:2.0:1788873754.351731:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065088 00000100:00100000:2.0:1788873754.351761:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065600 00000100:00100000:2.0:1788873754.351764:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065600 00000100:00100000:2.0:1788873754.351783:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788873754.351792:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859064576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351855:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859064576:12345-0@lo:400:kworker.0 Request processed in 63us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.351879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788873754.351909:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788873754.351916:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859065088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351945:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859065088:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.351951:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788873754.351963:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788873754.351969:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859065600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.351997:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859065600:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.352003:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788873754.352027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064448 00000100:00100000:2.0:1788873754.352031:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064448 00000100:00100000:2.0:1788873754.352059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788873754.352067:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859064448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352101:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859064448:12345-0@lo:400:kworker.0 Request processed in 36us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.352108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788873754.352142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064960 00000100:00100000:2.0:1788873754.352147:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064960 00000100:00100000:2.0:1788873754.352173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788873754.352180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859064960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859064960:12345-0@lo:400:kworker.0 Request processed in 75us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.352262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788873754.352294:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065472 00000100:00100000:2.0:1788873754.352298:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065472 00000100:00100000:2.0:1788873754.352325:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065984 00000100:00100000:2.0:1788873754.352328:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065984 00000100:00100000:2.0:1788873754.352351:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788873754.352358:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859065472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352393:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859065472:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.352400:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788873754.352413:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788873754.352419:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859065984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352448:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859065984:12345-0@lo:400:kworker.0 Request processed in 30us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.352455:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788873754.352477:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873754.352482:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873754.352526:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859064448:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352541:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859064960:0@lo:400:kworker.0 00010000:00080000:2.0:1788873754.352556:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343887b80 x1875769859065472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873754.352568:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859065472:0@lo:400:kworker.0 00010000:00080000:2.0:1788873754.352578:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abc000 x1875769859065984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873754.352586:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859065984:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352598:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859064576:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352620:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859065088:0@lo:400:kworker.0 00000100:00100000:2.0:1788873754.352629:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859065600:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.352967:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859064704:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353014:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873754.353051:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859065216:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873754.353098:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859065728:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873754.353144:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788873754.353152:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859064832:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873754.353195:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859065344:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353273:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873754.353308:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859065856:0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873754.353368:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065216 00000100:00100000:1.0:1788873754.353373:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065216 00000100:00100000:1.0:1788873754.353411:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065728 00000100:00100000:1.0:1788873754.353414:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065728 00000100:00100000:1.0:1788873754.353426:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064832 00000100:00100000:1.0:1788873754.353428:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064832 00000100:00100000:1.0:1788873754.353449:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788873754.353457:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859065216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353502:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859065216:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873754.353509:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788873754.353526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788873754.353533:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859065728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353561:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859065728:12345-0@lo:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873754.353568:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788873754.353579:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788873754.353585:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859064832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859064832:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873754.353619:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788873754.353647:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065344 00000100:00100000:1.0:1788873754.353650:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065344 00000100:00100000:1.0:1788873754.353674:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859065856 00000100:00100000:1.0:1788873754.353677:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859065856 00000100:00100000:1.0:1788873754.353698:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788873754.353713:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353747:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859065344:12345-0@lo:400:kworker.0 Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873754.353753:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788873754.353765:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788873754.353770:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859065856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873754.353795:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859065856:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873754.353801:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788873754.353828:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873754.353832:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873754.353863:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859064832:0@lo:400:kworker.0 00010000:00080000:1.0:1788873754.353876:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884380 x1875769859065344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873754.353886:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859065344:0@lo:400:kworker.0 00010000:00080000:1.0:1788873754.353895:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abca80 x1875769859065856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873754.353903:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859065856:0@lo:400:kworker.0 00010000:00080000:1.0:1788873754.353912:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884000 x1875769859065216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873754.353919:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859065216:0@lo:400:kworker.0 00010000:00080000:1.0:1788873754.353929:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abea00 x1875769859065728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873754.353936:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859065728:0@lo:400:kworker.0 00000100:00100000:0.0:1788873754.354105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859064704 00000100:00100000:0.0:1788873754.354112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859064704 00000100:00100000:0.0:1788873754.354154:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788873754.354163:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859064704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873754.354238:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859064704:12345-0@lo:400:kworker.0 Request processed in 77us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873754.354245:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788873754.354388:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859064704:0@lo:400:kworker.0 00010000:00010000:3.0:1788873754.736814:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873754.862580:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873754.862611:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859066112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873754.862731:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873754.862822:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066112 00000100:00100000:0.0:1788873754.862832:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066112 00000100:00100000:0.0:1788873754.863060:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788873754.863073:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859066112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873754.863120:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873754.863132:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859066240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873754.863167:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873754.863174:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859066112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873754.863231:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788873754.863249:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066240 00000100:00100000:3.0:1788873754.863254:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066240 00000100:00100000:3.0:1788873754.863285:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788873754.863289:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859066112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873754.863292:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859066240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873754.863314:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873754.863371:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859066240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873754.863378:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788873754.863534:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859066368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873754.863566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873754.864467:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066368 00000100:00100000:2.0:1788873754.864479:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066368 00000100:00100000:2.0:1788873754.864533:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788873754.864542:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859066368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873754.864564:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873754.864621:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859066368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873754.864627:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788873754.864695:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475e59880 x1875769859066368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873754.864715:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859066368:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788873754.865165:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f44c000 x1875769859066240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873754.865181:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859066240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788873755.759834:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873756.790581:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873757.423245:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873757.423279:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859066496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873757.423464:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873757.424740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066496 00000100:00100000:1.0:1788873757.424758:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066496 00000100:00100000:1.0:1788873757.424836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788873757.424849:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345884f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859066496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873757.424907:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788873757.425119:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345884f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859066496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 272us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873757.425127:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788873757.426355:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859066496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788873757.807649:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873758.834451:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873758.959392:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873758.959427:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859066624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873758.959536:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873758.959634:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066624 00000100:00100000:1.0:1788873758.959644:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066624 00000100:00100000:1.0:1788873758.959729:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788873758.959742:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859066624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788873758.959781:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873758.959832:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859066624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873758.959852:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788873758.959877:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873758.959913:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abca80 x1875769859066624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873758.959937:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859066624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873758.962081:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859066752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873758.962253:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873758.962686:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066752 00000100:00100000:1.0:1788873758.962716:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066752 00000100:00100000:1.0:1788873758.962819:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788873758.962834:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859066752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873758.963438:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873758.963536:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859066752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 704us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873758.963545:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788873758.963868:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475e5b480 x1875769859066752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873758.963897:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859066752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788873758.964530:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873759.368754:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873759.368800:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873759.368907:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117760 00000100:00100000:3.0:1788873759.368921:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117760 00000100:00100000:3.0:1788873759.368999:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 286 00000100:00100000:3.0:1788873759.369011:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840117760:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873759.369100:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840117760:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 92us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873759.369108:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 286 00000100:00100000:0.0:1788873759.369516:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873759.377747:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118016 00000100:00100000:2.0:1788873759.377766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118016 00000100:00100000:2.0:1788873759.377910:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840117888 00000100:00100000:2.0:1788873759.377914:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840117888 00000100:00100000:1.0:1788873759.377999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 121 00000100:00100000:1.0:1788873759.378015:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840118016:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873759.378123:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840118016:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 113us (9322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873759.378143:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 121 00000100:00080000:0.0:1788873759.382539:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873759.382551:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873759.383435:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:2.0:1788873759.383453:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840117888:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873759.383576:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840117888:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 129us (14060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.383584:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:0.0:1788873759.470463:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859067008:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.470567:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873759.470634:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859067520:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.470693:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873759.470721:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859068032:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.470745:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873759.470773:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788873759.470778:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859067136:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.470899:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873759.470917:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859067648:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.470937:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873759.470965:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859068160:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.470984:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873759.471017:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067008 00000100:00100000:0.0:1788873759.471028:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067008 00000100:00100000:0.0:1788873759.471079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067520 00000100:00100000:0.0:1788873759.471083:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067520 00000100:00100000:0.0:1788873759.471110:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068032 00000100:00100000:0.0:1788873759.471113:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068032 00000100:00100000:0.0:1788873759.471125:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067648 00000100:00100000:0.0:1788873759.471127:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067648 00000100:00100000:0.0:1788873759.471139:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068160 00000100:00100000:0.0:1788873759.471141:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068160 00000100:00100000:0.0:1788873759.471172:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788873759.471183:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859067008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471283:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859067008:12345-0@lo:400:kworker.0 Request processed in 102us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873759.471291:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788873759.471315:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788873759.471320:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859067520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471346:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859067520:12345-0@lo:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873759.471352:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788873759.471363:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788873759.471368:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859068032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471394:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859068032:12345-0@lo:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873759.471400:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788873759.471411:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788873759.471425:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471454:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859067648:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873759.471461:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788873759.471474:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788873759.471481:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859068160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471508:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859068160:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873759.471513:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788873759.471546:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067136 00000100:00100000:0.0:1788873759.471550:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067136 00000100:00100000:0.0:1788873759.471581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788873759.471588:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859067136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471623:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859067136:12345-0@lo:400:kworker.0 Request processed in 36us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873759.471629:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788873759.471651:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873759.471655:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873759.471696:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859067136:0@lo:400:kworker.0 00010000:00080000:0.0:1788873759.471711:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8700 x1875769859067648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873759.471723:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859067648:0@lo:400:kworker.0 00010000:00080000:0.0:1788873759.471734:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8a80 x1875769859068160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873759.471742:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859068160:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471764:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859067008:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471773:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859067520:0@lo:400:kworker.0 00000100:00100000:0.0:1788873759.471781:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859068032:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.472724:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859067264:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.472795:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.472852:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859067776:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.472885:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.472926:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859068288:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.472950:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.472993:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788873759.473002:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859066880:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.473037:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.473060:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859067392:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.473087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.473108:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859067904:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.473131:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.473151:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859068416:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.473186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873759.473426:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067264 00000100:00100000:2.0:1788873759.473437:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067264 00000100:00100000:2.0:1788873759.473491:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788873759.473501:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859067264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.473568:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859067264:12345-0@lo:400:kworker.0 Request processed in 68us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.473575:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788873759.473616:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067776 00000100:00100000:2.0:1788873759.473620:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067776 00000100:00100000:2.0:1788873759.474541:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068288 00000100:00100000:2.0:1788873759.474553:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068288 00000100:00100000:2.0:1788873759.474609:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067904 00000100:00100000:2.0:1788873759.474612:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067904 00000100:00100000:2.0:1788873759.474625:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068416 00000100:00100000:2.0:1788873759.474657:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068416 00000100:00100000:2.0:1788873759.474683:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873759.474691:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859067776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.474756:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859067776:12345-0@lo:400:kworker.0 Request processed in 65us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.474764:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873759.474786:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873759.474792:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859068288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.474821:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859068288:12345-0@lo:400:kworker.0 Request processed in 30us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.474827:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873759.474838:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873759.474844:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859067904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.474870:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859067904:12345-0@lo:400:kworker.0 Request processed in 26us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.474876:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873759.474886:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788873759.474891:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859068416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.474917:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859068416:12345-0@lo:400:kworker.0 Request processed in 27us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.474923:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788873759.474953:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859066880 00000100:00100000:2.0:1788873759.474957:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859066880 00000100:00100000:2.0:1788873759.474987:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788873759.474994:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859066880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.475029:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859066880:12345-0@lo:400:kworker.0 Request processed in 36us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.475042:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788873759.475083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859067392 00000100:00100000:2.0:1788873759.475088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859067392 00000100:00100000:2.0:1788873759.475119:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788873759.475125:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859067392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.475176:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859067392:12345-0@lo:400:kworker.0 Request processed in 51us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873759.475182:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788873759.475234:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873759.475716:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859066880:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.475736:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859067392:0@lo:400:kworker.0 00010000:00080000:2.0:1788873759.475755:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e9500 x1875769859067904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873759.475767:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859067904:0@lo:400:kworker.0 00010000:00080000:2.0:1788873759.475779:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ea680 x1875769859068416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873759.475787:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859068416:0@lo:400:kworker.0 00000100:00100000:2.0:1788873759.475803:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859067264:0@lo:400:kworker.0 00010000:00080000:2.0:1788873759.475816:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8000 x1875769859067776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873759.475825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859067776:0@lo:400:kworker.0 00010000:00080000:2.0:1788873759.475911:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ea300 x1875769859068288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873759.475933:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859068288:0@lo:400:kworker.0 00010000:00010000:3.0:1788873759.855804:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873759.985406:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859068544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873759.985502:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873759.985635:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068544 00000100:00100000:3.0:1788873759.985646:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068544 00000100:00100000:3.0:1788873759.985708:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788873759.985719:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859068544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873759.985765:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873759.985823:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859068544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873759.985831:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788873759.985890:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859068544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873759.986889:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859068672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873759.986957:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873759.987287:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859068800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873759.987324:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873759.989125:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068672 00000100:00100000:3.0:1788873759.989146:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068672 00000100:00100000:3.0:1788873759.989326:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068800 00000100:00100000:3.0:1788873759.989331:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068800 00000100:00100000:3.0:1788873759.989356:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788873759.989366:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859068672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873759.989408:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873759.989522:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859068672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873759.989529:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788873759.989550:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788873759.989557:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859068800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873759.989568:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873759.989602:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859068800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873759.989618:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788873759.989668:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475e5a300 x1875769859068672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873759.989696:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859068672:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788873759.990024:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3451800a80 x1875769859068800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873759.990042:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859068800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788873760.884112:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873761.904355:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873762.546911:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859068928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873762.547024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873762.547245:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859068928 00000100:00100000:0.0:1788873762.547257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859068928 00000100:00100000:0.0:1788873762.547328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788873762.547339:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859068928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873762.547392:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873762.547465:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859068928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873762.547472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788873762.547972:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859068928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873762.933776:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873763.952961:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873764.078546:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873764.078580:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859069056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873764.078698:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873764.078887:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069056 00000100:00100000:0.0:1788873764.078897:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069056 00000100:00100000:0.0:1788873764.078969:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788873764.078983:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859069056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873764.079022:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873764.079086:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859069056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873764.079093:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788873764.079158:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1c700 x1875769859069056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873764.079182:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859069056:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788873764.079387:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873764.079557:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873764.079571:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859069184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873764.079691:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873764.079841:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069184 00000100:00100000:0.0:1788873764.079848:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069184 00000100:00100000:0.0:1788873764.079904:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788873764.079912:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859069184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788873764.079931:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873764.079968:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859069184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873764.079975:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788873764.080033:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873764.080057:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1c700 x1875769859069184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873764.080073:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859069184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873764.489031:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873764.489141:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873764.489172:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873764.489224:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118400 00000100:00100000:1.0:1788873764.489236:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118400 00000100:00100000:1.0:1788873764.489305:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118272 00000100:00100000:1.0:1788873764.489309:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118272 00000100:00100000:1.0:1788873764.489336:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 129 00000100:00100000:1.0:1788873764.489348:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840118400:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873764.489443:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840118400:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873764.489451:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 129 00000100:00100000:1.0:1788873764.489470:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 130 00000100:00100000:1.0:1788873764.489478:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840118272:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873764.489505:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840118272:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873764.489512:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 130 00000100:00080000:1.0:1788873764.489537:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873764.489542:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873764.490565:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118144 00000100:00100000:2.0:1788873764.490579:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118144 00000100:00100000:2.0:1788873764.490642:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 288 00000100:00100000:2.0:1788873764.490652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840118144:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873764.490724:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2400:x1875769840118144:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 73us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873764.490733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 288 00000100:00100000:3.0:1788873764.591264:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859069312:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.591366:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.591432:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859069824:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.591488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.591517:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859070336:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.591546:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.591580:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788873764.591587:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859069440:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.591627:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.591648:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859069952:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.591672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.591692:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.591719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.591757:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859069568:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.593013:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.593133:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859070080:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.593183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.593232:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859070592:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.593279:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.593314:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788873764.593322:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859069696:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.593346:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.593366:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859070208:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.593391:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873764.593434:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069312 00000100:00100000:3.0:1788873764.593445:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069312 00000100:00100000:3.0:1788873764.593516:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788873764.593527:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859069312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.593629:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859069312:12345-0@lo:400:kworker.0 Request processed in 103us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.593637:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788873764.595353:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069824 00000100:00100000:2.0:1788873764.595369:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069824 00000100:00100000:2.0:1788873764.595470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069568 00000100:00100000:2.0:1788873764.595474:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069568 00000100:00100000:2.0:1788873764.595499:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788873764.595509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859069824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873764.595615:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859069824:12345-0@lo:400:kworker.0 Request processed in 108us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873764.595623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788873764.595652:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788873764.595658:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859069568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873764.595714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859069568:12345-0@lo:400:kworker.0 Request processed in 55us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873764.595721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788873764.596059:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070336 00000100:00100000:3.0:1788873764.596065:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070336 00000100:00100000:3.0:1788873764.596125:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069440 00000100:00100000:3.0:1788873764.596129:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069440 00000100:00100000:3.0:1788873764.596145:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069952 00000100:00100000:3.0:1788873764.596148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069952 00000100:00100000:3.0:1788873764.596164:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070080 00000100:00100000:3.0:1788873764.596167:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070080 00000100:00100000:3.0:1788873764.596180:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859069696 00000100:00100000:3.0:1788873764.596183:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859069696 00000100:00100000:3.0:1788873764.596194:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070208 00000100:00100000:3.0:1788873764.596197:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070208 00000100:00100000:3.0:1788873764.596242:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788873764.596250:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859070336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596302:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859070336:12345-0@lo:400:kworker.0 Request processed in 53us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788873764.596334:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788873764.596339:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859069440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596373:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859069440:12345-0@lo:400:kworker.0 Request processed in 34us (4746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596378:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788873764.596390:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788873764.596396:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859069952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596426:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859069952:12345-0@lo:400:kworker.0 Request processed in 31us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596431:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788873764.596442:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873764.596448:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859070080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596478:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859070080:12345-0@lo:400:kworker.0 Request processed in 31us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596484:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873764.596495:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788873764.596500:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859069696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596531:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859069696:12345-0@lo:400:kworker.0 Request processed in 30us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596537:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788873764.596548:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788873764.596554:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859070208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596585:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859070208:12345-0@lo:400:kworker.0 Request processed in 31us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596664:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788873764.596701:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070464 00000100:00100000:3.0:1788873764.596705:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070464 00000100:00100000:3.0:1788873764.596737:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070592 00000100:00100000:3.0:1788873764.596740:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070592 00000100:00100000:3.0:1788873764.596767:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788873764.596774:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859070464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.596956:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859070464:12345-0@lo:400:kworker.0 Request processed in 182us (5236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.596963:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788873764.596977:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788873764.596984:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859070592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597016:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859070592:12345-0@lo:400:kworker.0 Request processed in 32us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873764.597022:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788873764.597130:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859069696:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597146:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859070208:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597160:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859069568:0@lo:400:kworker.0 00010000:00080000:3.0:1788873764.597178:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1ed80 x1875769859070080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873764.597192:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859070080:0@lo:400:kworker.0 00010000:00080000:3.0:1788873764.597229:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1e300 x1875769859070592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873764.597239:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859070592:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597300:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859069440:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597316:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859069952:0@lo:400:kworker.0 00010000:00080000:3.0:1788873764.597329:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1c000 x1875769859070464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873764.597338:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597352:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859069312:0@lo:400:kworker.0 00000100:00100000:3.0:1788873764.597365:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859069824:0@lo:400:kworker.0 00010000:00080000:3.0:1788873764.597377:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1ea00 x1875769859070336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873764.597385:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859070336:0@lo:400:kworker.0 00000100:00080000:1.0:1788873764.597518:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873764.597525:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873764.597527:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788873764.975251:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873765.103915:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859070720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873765.104032:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873765.104752:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070720 00000100:00100000:0.0:1788873765.104765:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070720 00000100:00100000:0.0:1788873765.104831:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788873765.104845:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859070720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873765.104900:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873765.104970:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859070720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873765.104978:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788873765.105233:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1ed80 x1875769859070720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873765.105264:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859070720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873765.107364:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859070848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873765.107465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873765.111961:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859070976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873765.112078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873765.116006:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070848 00000100:00100000:2.0:1788873765.116030:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070848 00000100:00100000:2.0:1788873765.116133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859070976 00000100:00100000:2.0:1788873765.116139:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859070976 00000100:00100000:2.0:1788873765.117761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788873765.117781:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859070976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873765.117835:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788873765.117976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859070976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 199us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873765.117985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788873765.124440:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859070976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873765.124575:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788873765.124589:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859070848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873765.124857:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873765.124988:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859070848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 401us (17522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873765.124996:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788873765.125250:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475e59880 x1875769859070848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873765.125276:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859070848:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788873766.000386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873767.023447:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873767.665008:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859071104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873767.665130:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873767.665355:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071104 00000100:00100000:0.0:1788873767.665366:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071104 00000100:00100000:0.0:1788873767.665431:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788873767.665443:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859071104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873767.665490:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873767.665553:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859071104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873767.665562:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788873767.665732:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859071104:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873768.046559:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873769.070533:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873769.199874:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859071232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873769.199955:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.200015:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071232 00000100:00100000:0.0:1788873769.200029:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071232 00000100:00100000:0.0:1788873769.200163:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788873769.200180:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859071232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873769.200249:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873769.200342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859071232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.200350:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788873769.200456:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788873769.200499:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1ea00 x1875769859071232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873769.200526:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859071232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873769.203976:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859071360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873769.204143:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873769.204390:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071360 00000100:00100000:3.0:1788873769.204401:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071360 00000100:00100000:3.0:1788873769.204553:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788873769.204565:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859071360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873769.204594:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873769.204671:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859071360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873769.204678:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788873769.204709:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3451803100 x1875769859071360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873769.204715:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873769.204735:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859071360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873769.615391:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873769.615444:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873769.615504:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873769.615603:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118528 00000100:00100000:3.0:1788873769.615618:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118528 00000100:00100000:3.0:1788873769.615707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 290 00000100:00100000:3.0:1788873769.615734:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840118528:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873769.615831:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840118528:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 99us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873769.615840:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 290 00000100:00100000:3.0:1788873769.615894:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118784 00000100:00100000:3.0:1788873769.615899:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118784 00000100:00100000:3.0:1788873769.615941:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118656 00000100:00100000:3.0:1788873769.615944:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118656 00000100:00100000:3.0:1788873769.615966:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 137 00000100:00100000:3.0:1788873769.615972:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840118784:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873769.616010:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840118784:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 37us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873769.616017:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 137 00000100:00100000:3.0:1788873769.616030:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:3.0:1788873769.616037:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840118656:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873769.616076:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840118656:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 40us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873769.616082:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00080000:3.0:1788873769.616290:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873769.616296:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873769.715029:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859071616:0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715160:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.715281:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859072128:0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715307:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.715337:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859072640:0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715369:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.715400:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788873769.715405:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859071744:0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715428:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.715446:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859072256:0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715465:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.715484:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859072768:0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715505:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873769.715547:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071616 00000100:00100000:0.0:1788873769.715588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071616 00000100:00100000:0.0:1788873769.715646:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072128 00000100:00100000:0.0:1788873769.715787:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072128 00000100:00100000:0.0:1788873769.715828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072256 00000100:00100000:0.0:1788873769.715831:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072256 00000100:00100000:0.0:1788873769.715851:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788873769.715860:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859071616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.715942:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859071616:12345-0@lo:400:kworker.0 Request processed in 82us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.715950:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788873769.715971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788873769.715977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859072128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.716007:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859072128:12345-0@lo:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.716013:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788873769.716024:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788873769.716030:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859072256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.716072:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859072256:12345-0@lo:400:kworker.0 Request processed in 42us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.716078:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788873769.716107:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072640 00000100:00100000:0.0:1788873769.716111:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072640 00000100:00100000:0.0:1788873769.716139:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072768 00000100:00100000:0.0:1788873769.716143:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072768 00000100:00100000:0.0:1788873769.716167:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788873769.716175:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859072640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.716246:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859072640:12345-0@lo:400:kworker.0 Request processed in 72us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.716265:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788873769.716277:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788873769.716284:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859072768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.716313:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859072768:12345-0@lo:400:kworker.0 Request processed in 30us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.716320:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788873769.716339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071744 00000100:00100000:0.0:1788873769.716343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071744 00000100:00100000:0.0:1788873769.716371:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788873769.716378:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859071744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873769.716412:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859071744:12345-0@lo:400:kworker.0 Request processed in 34us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873769.716419:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788873769.716450:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873769.716458:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873769.716461:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873769.716515:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859071744:0@lo:400:kworker.0 00010000:00080000:0.0:1788873769.716530:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1ed80 x1875769859072256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873769.716541:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859072256:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.718694:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859071488:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.718800:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873769.718868:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859072000:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.718900:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873769.718924:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859072512:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.718971:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873769.719004:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788873769.719012:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859071872:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.719035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873769.719074:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859072384:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.719097:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873769.719137:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071488 00000100:00100000:3.0:1788873769.719147:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071488 00000100:00100000:3.0:1788873769.719223:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788873769.719236:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859071488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.719295:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859071488:12345-0@lo:400:kworker.0 Request processed in 63us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873769.719304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788873769.719340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072000 00000100:00100000:3.0:1788873769.719344:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072000 00000100:00100000:3.0:1788873769.719370:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788873769.719377:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859072000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.719413:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859072000:12345-0@lo:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873769.719420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788873769.719461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859071488:0@lo:400:kworker.0 00000100:00100000:3.0:1788873769.719475:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859072000:0@lo:400:kworker.0 00000100:00100000:1.0:1788873769.720173:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072512 00000100:00100000:1.0:1788873769.720179:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072512 00000100:00100000:1.0:1788873769.720265:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859071872 00000100:00100000:1.0:1788873769.720270:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859071872 00000100:00100000:1.0:1788873769.720288:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072384 00000100:00100000:1.0:1788873769.720291:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072384 00000100:00100000:1.0:1788873769.720310:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788873769.720318:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875769859072512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873769.720373:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875769859072512:12345-0@lo:400:kworker.0 Request processed in 56us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873769.720381:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788873769.720396:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788873769.720403:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859071872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873769.720433:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859071872:12345-0@lo:400:kworker.0 Request processed in 31us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873769.720439:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788873769.720449:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788873769.720456:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859072384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873769.720481:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859072384:12345-0@lo:400:kworker.0 Request processed in 26us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873769.720517:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788873769.720575:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859071872:0@lo:400:kworker.0 00000100:00100000:1.0:1788873769.720589:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859072384:0@lo:400:kworker.0 00010000:00080000:1.0:1788873769.720602:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1d880 x1875769859072512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873769.720615:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859072512:0@lo:400:kworker.0 00010000:00080000:0.0:1788873769.720946:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8000 x1875769859072768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873769.721283:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859072768:0@lo:400:kworker.0 00000100:00080000:3.0:1788873769.723771:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873769.723786:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873769.725967:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859071616:0@lo:400:kworker.0 00000100:00100000:1.0:1788873769.725988:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859072128:0@lo:400:kworker.0 00010000:00080000:1.0:1788873769.726006:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ea300 x1875769859072640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873769.726018:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859072640:0@lo:400:kworker.0 00000001:02000400:2.0:1788873769.780874:0:11991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:22:48 (1788873768) === 00010000:00010000:0.0:1788873770.095267:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873770.169761:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.169901:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840118912 00000100:00100000:0.0:1788873770.169912:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840118912 00000100:00100000:0.0:1788873770.169980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 292 00000100:00100000:0.0:1788873770.169988:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:8725:x1875769840118912:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788873770.170005:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873770.170023:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b6e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9517 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873770.170083:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9517 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873770.170096:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9517 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873770.170105:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92c00, rc 0) 00000100:00100000:0.0:1788873770.170164:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8725:x1875769840118912:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 176us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.170172:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 292 00000100:00100000:3.0:1788873770.172784:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.173061:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119040 00000100:00100000:0.0:1788873770.173072:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119040 00000100:00100000:0.0:1788873770.173168:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 293 00000100:00100000:0.0:1788873770.173183:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8725:x1875769840119040:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788873770.173419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8725:x1875769840119040:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 239us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.173427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 293 00000100:00100000:2.0:1788873770.181811:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.182001:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119168 00000100:00100000:1.0:1788873770.182012:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119168 00000100:00100000:1.0:1788873770.182151:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 294 00000100:00100000:1.0:1788873770.182162:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8725:x1875769840119168:12345-192.168.202.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788873770.182899:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8725:x1875769840119168:12345-192.168.202.20@tcp:503:mount.lustre.0 Request processed in 732us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.182912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 294 00000100:00100000:1.0:1788873770.197938:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.198267:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119296 00000100:00100000:0.0:1788873770.198278:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119296 00000100:00100000:0.0:1788873770.198844:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 295 00000100:00100000:0.0:1788873770.198871:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8729:x1875769840119296:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788873770.199037:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8729:x1875769840119296:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 169us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.199060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 295 00000100:00100000:2.0:1788873770.222759:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859072896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873770.222835:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873770.222929:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859072896 00000100:00100000:2.0:1788873770.222939:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859072896 00000100:00100000:2.0:1788873770.222991:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788873770.223002:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859072896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873770.223033:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873770.223098:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859072896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873770.223105:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788873770.223172:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884e00 x1875769859072896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873770.223227:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859072896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873770.223879:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873770.223898:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859073024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873770.223940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873770.224746:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073024 00000100:00100000:1.0:1788873770.224755:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073024 00000100:00100000:1.0:1788873770.224818:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788873770.224828:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859073024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873770.224852:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873770.224904:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859073024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.224911:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788873770.225001:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3451803100 x1875769859073024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873770.225018:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859073024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873770.227025:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859073152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873770.227177:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873770.227926:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073152 00000100:00100000:2.0:1788873770.227937:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073152 00000100:00100000:2.0:1788873770.228035:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788873770.228062:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859073152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873770.228114:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788873770.228193:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859073152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873770.228200:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788873770.228363:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859073152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873770.242015:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.242159:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119424 00000100:00100000:1.0:1788873770.242171:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119424 00000100:00100000:1.0:1788873770.242265:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 296 00000100:00100000:1.0:1788873770.242276:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8729:x1875769840119424:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788873770.243715:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8729:x1875769840119424:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 1430us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.244998:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 296 00000100:00100000:2.0:1788873770.249591:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873770.250977:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119552 00000100:00100000:3.0:1788873770.250991:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119552 00000100:00100000:3.0:1788873770.251121:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 297 00000100:00100000:3.0:1788873770.251133:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8729:x1875769840119552:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788873770.251368:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8729:x1875769840119552:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 233us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873770.251377:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 297 00000100:00100000:2.0:1788873770.263699:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.263875:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119680 00000100:00100000:1.0:1788873770.263885:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119680 00000100:00100000:1.0:1788873770.263970:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 298 00000100:00100000:1.0:1788873770.263982:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:8725:x1875769840119680:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788873770.263999:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873770.264017:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfea800/0x25c660afb0a9b6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9548 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873770.264061:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfea800/0x25c660afb0a9b6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9548 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873770.264091:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfea800/0x25c660afb0a9b6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9548 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873770.264100:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfea800, rc 0) 00000100:00100000:1.0:1788873770.264158:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:8725:x1875769840119680:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 178us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.264165:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 298 00000100:00100000:2.0:1788873770.274435:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873770.274584:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119808 00000100:00100000:3.0:1788873770.274595:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119808 00000100:00100000:3.0:1788873770.274661:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 299 00000100:00100000:3.0:1788873770.274671:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:8725:x1875769840119808:12345-192.168.202.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788873770.274696:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788873770.274719:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788873770.274722:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788873770.274724:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788873770.274727:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788873770.274736:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788873770.280342:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:8725:x1875769840119808:12345-192.168.202.20@tcp:256:mount.lustre.0 Request processed in 5659us (5901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873770.280360:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 299 00000100:00100000:2.0:1788873770.285600:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.285776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840119936 00000100:00100000:1.0:1788873770.285786:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840119936 00000100:00100000:1.0:1788873770.285847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 300 00000100:00100000:1.0:1788873770.285858:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:8725:x1875769840119936:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788873770.285875:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873770.285893:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a954f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873770.285922:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873770.285933:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873770.285942:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d344cfeae00, rc 0) 00000100:00100000:1.0:1788873770.286000:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8725:x1875769840119936:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 143us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.286007:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 300 00000100:00100000:2.0:1788873770.293303:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873770.297641:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120064 00000100:00100000:3.0:1788873770.297692:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120064 00000100:00100000:3.0:1788873770.297791:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 301 00000100:00100000:3.0:1788873770.297813:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8725:x1875769840120064:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788873770.298041:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8725:x1875769840120064:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 230us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873770.298069:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 301 00000100:00100000:2.0:1788873770.300688:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.300802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120192 00000100:00100000:0.0:1788873770.300822:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120192 00000100:00100000:0.0:1788873770.300966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 302 00000100:00100000:0.0:1788873770.300980:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8725:x1875769840120192:12345-192.168.202.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788873770.301162:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8725:x1875769840120192:12345-192.168.202.20@tcp:503:mount.lustre.0 Request processed in 185us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.301171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 302 00000100:00100000:2.0:1788873770.304909:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.305038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120320 00000100:00100000:1.0:1788873770.305078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120320 00000100:00100000:1.0:1788873770.305155:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 303 00000100:00100000:1.0:1788873770.305167:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8735:x1875769840120320:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788873770.305566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8735:x1875769840120320:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 399us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.305575:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 303 00000100:00100000:2.0:1788873770.316901:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.317288:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120448 00000100:00100000:0.0:1788873770.317303:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120448 00000100:00100000:0.0:1788873770.317496:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 304 00000100:00100000:0.0:1788873770.317510:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8735:x1875769840120448:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788873770.317766:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:8735:x1875769840120448:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 259us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.317775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 304 00000100:00100000:2.0:1788873770.343263:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873770.343308:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873770.343332:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873770.343377:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.343542:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120576 00000100:00100000:1.0:1788873770.343556:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120576 00000100:00100000:1.0:1788873770.343611:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120832 00000100:00100000:1.0:1788873770.343614:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120832 00000100:00100000:1.0:1788873770.343623:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121216 00000100:00100000:1.0:1788873770.343626:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121216 00000100:00100000:1.0:1788873770.343663:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121344 00000100:00100000:1.0:1788873770.343666:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121344 00000100:00100000:1.0:1788873770.343686:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 145 00000100:00100000:1.0:1788873770.343697:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840121216:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873770.343943:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840121216:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 246us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.343952:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 145 00000100:00100000:1.0:1788873770.343974:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 146 00000100:00100000:1.0:1788873770.343981:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840121344:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873770.344010:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840121344:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.344016:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 146 00000100:00100000:1.0:1788873770.344029:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:1.0:1788873770.344034:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875769840120576:12345-192.168.202.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788873770.344092:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c8c7e5d0-b07e-4fb6-a776-a6d6096278d7@192.168.202.20@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:1.0:1788873770.344150:0:8450:0:(genops.c:1385:class_connect()) connect: client c8c7e5d0-b07e-4fb6-a776-a6d6096278d7, cookie 0x25c660afb0a9b6f5 00000004:00100000:1.0:1788873770.344186:0:8450:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788873770.344475:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:2.0:1788873770.344483:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1875769840120832:12345-192.168.202.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788873770.344506:0:8993:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c8c7e5d0-b07e-4fb6-a776-a6d6096278d7@192.168.202.20@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1788873770.344553:0:8993:0:(genops.c:1385:class_connect()) connect: client c8c7e5d0-b07e-4fb6-a776-a6d6096278d7, cookie 0x25c660afb0a9b6fc 00000004:00100000:2.0:1788873770.344573:0:8993:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788873770.345297:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9d3343ac8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788873770.345445:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2397:x1875769840120576:12345-192.168.202.20@tcp:38:mount.lustre.0 Request processed in 1405us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873770.345458:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00080000:2.0:1788873770.347892:0:8993:0:(import.c:65:import_set_state_nolock()) ffff9d3343a8d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873770.348309:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2397:x1875769840120832:12345-192.168.202.20@tcp:38:mount.lustre.0 Request processed in 3820us (4995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873770.348321:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:2.0:1788873770.355927:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873770.355984:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873770.356119:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.356329:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121088 00000100:00100000:0.0:1788873770.356344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121088 00000100:00100000:0.0:1788873770.356449:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120704 00000100:00100000:0.0:1788873770.356453:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120704 00000100:00100000:0.0:1788873770.356470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840120960 00000100:00100000:0.0:1788873770.356473:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840120960 00000100:00100000:0.0:1788873770.356493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:0.0:1788873770.356505:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+7:8725:x1875769840121088:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788873770.356582:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873770.356710:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+7:8725:x1875769840121088:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 206us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.356718:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:0.0:1788873770.356741:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:0.0:1788873770.356748:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:0:x1875769840120704:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788873770.356761:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873770.356786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:0:x1875769840120704:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.356792:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:0.0:1788873770.356805:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:0.0:1788873770.356812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:0:x1875769840120960:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788873770.356825:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873770.356867:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:0:x1875769840120960:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 56us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.356872:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00080000:2.0:1788873770.357453:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873770.357459:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873770.361271:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.362131:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121472 00000100:00100000:0.0:1788873770.362147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121472 00000100:00100000:0.0:1788873770.362274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:0.0:1788873770.362287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:8725:x1875769840121472:12345-192.168.202.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788873770.362417:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:8725:x1875769840121472:12345-192.168.202.20@tcp:40:mount.lustre.0 Request processed in 133us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.362425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:0.0:1788873770.368910:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873770.369676:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121600 00000100:00100000:3.0:1788873770.369691:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121600 00000100:00100000:3.0:1788873770.369758:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:3.0:1788873770.369771:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875769840121600:12345-192.168.202.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788873770.369818:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c8c7e5d0-b07e-4fb6-a776-a6d6096278d7@192.168.202.20@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:3.0:1788873770.369863:0:8427:0:(genops.c:1385:class_connect()) connect: client c8c7e5d0-b07e-4fb6-a776-a6d6096278d7, cookie 0x25c660afb0a9b703 00002000:00100000:3.0:1788873770.369880:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c8c7e5d0-b07e-4fb6-a776-a6d6096278d7/ffff9d3342b94800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788873770.369895:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788873770.370145:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788873770.370186:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d3342b96000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873770.370453:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2397:x1875769840121600:12345-192.168.202.20@tcp:8:mount.lustre.0 Request processed in 682us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873770.370463:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:1.0:1788873770.370665:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873770.370826:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873770.370954:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121728 00000100:00100000:0.0:1788873770.370962:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121728 00000100:00100000:0.0:1788873770.371014:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:0.0:1788873770.371021:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875769840121728:12345-192.168.202.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788873770.371064:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c8c7e5d0-b07e-4fb6-a776-a6d6096278d7@192.168.202.20@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:0.0:1788873770.371093:0:8424:0:(genops.c:1385:class_connect()) connect: client c8c7e5d0-b07e-4fb6-a776-a6d6096278d7, cookie 0x25c660afb0a9b70a 00002000:00100000:0.0:1788873770.371104:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c8c7e5d0-b07e-4fb6-a776-a6d6096278d7/ffff9d347a75c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788873770.371113:0:8424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788873770.371185:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788873770.371237:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9d347a75d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873770.371284:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2397:x1875769840121728:12345-192.168.202.20@tcp:8:mount.lustre.0 Request processed in 262us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873770.371292:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:3.0:1788873770.371588:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121856 00000100:00100000:3.0:1788873770.371595:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121856 00000100:00100000:3.0:1788873770.371790:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:3.0:1788873770.371838:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:8725:x1875769840121856:12345-192.168.202.20@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788873770.371904:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:8725:x1875769840121856:12345-192.168.202.20@tcp:900:mount.lustre.0 Request processed in 106us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873770.371934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:0.0:1788873770.387910:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873770.388258:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840121984 00000100:00100000:2.0:1788873770.388271:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840121984 00000100:00100000:2.0:1788873770.388357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:2.0:1788873770.388370:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:8725:x1875769840121984:12345-192.168.202.20@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788873770.388504:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788873770.388608:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:8725:x1875769840121984:12345-192.168.202.20@tcp:33:mount.lustre.0 Request processed in 240us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873770.388617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 1 00010000:00010000:2.0:1788873771.118659:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873772.142398:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873772.784886:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873772.784949:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859073280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873772.785047:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873772.785384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073280 00000100:00100000:1.0:1788873772.785394:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073280 00000100:00100000:1.0:1788873772.786954:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788873772.786972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859073280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873772.787012:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788873772.787142:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859073280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873772.787149:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873772.787984:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859073280:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873773.166554:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873774.190439:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873774.319240:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859073408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873774.319341:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873774.319455:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073408 00000100:00100000:2.0:1788873774.319461:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073408 00000100:00100000:2.0:1788873774.319529:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788873774.319540:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859073408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873774.319575:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873774.319654:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859073408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873774.319661:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788873774.319751:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abfb80 x1875769859073408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873774.319772:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859073408:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788873774.319819:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873774.320175:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859073536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873774.320229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.320297:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073536 00000100:00100000:3.0:1788873774.320302:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073536 00000100:00100000:3.0:1788873774.320351:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788873774.320358:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859073536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873774.320372:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788873774.320481:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873774.322224:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859073536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1847us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873774.322235:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788873774.322374:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885c00 x1875769859073536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873774.322397:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859073536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873774.830743:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859073792:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.830848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.830915:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859074304:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.830941:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.830966:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859074816:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.830990:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.831024:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788873774.831031:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859073664:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831060:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.831081:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859074176:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831116:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.831137:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859074688:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831167:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873774.831197:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073792 00000100:00100000:3.0:1788873774.831239:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073792 00000100:00100000:3.0:1788873774.831280:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074304 00000100:00100000:3.0:1788873774.831283:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074304 00000100:00100000:3.0:1788873774.831306:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074688 00000100:00100000:3.0:1788873774.831309:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074688 00000100:00100000:3.0:1788873774.831327:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788873774.831335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859073792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831388:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859073792:12345-0@lo:400:kworker.0 Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873774.831395:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788873774.831412:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788873774.831418:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859074304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831444:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859074304:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873774.831450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788873774.831460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788873774.831466:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859074688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831490:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859074688:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873774.831495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788873774.831513:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074816 00000100:00100000:3.0:1788873774.831516:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074816 00000100:00100000:3.0:1788873774.831539:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788873774.831545:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859074816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831574:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859074816:12345-0@lo:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873774.831586:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788873774.831604:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074176 00000100:00100000:3.0:1788873774.831608:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074176 00000100:00100000:3.0:1788873774.831630:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788873774.831636:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859074176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831667:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859074176:12345-0@lo:400:kworker.0 Request processed in 31us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873774.831673:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788873774.831716:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859074176:0@lo:400:kworker.0 00010000:00080000:3.0:1788873774.831729:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5a680 x1875769859074688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873774.831737:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859074688:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831747:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859073792:0@lo:400:kworker.0 00000100:00100000:3.0:1788873774.831756:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859074304:0@lo:400:kworker.0 00010000:00080000:3.0:1788873774.831764:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f428700 x1875769859074816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873774.831771:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859074816:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832064:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073664 00000100:00100000:1.0:1788873774.832075:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073664 00000100:00100000:1.0:1788873774.832121:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788873774.832129:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859073664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832170:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859073664:12345-0@lo:400:kworker.0 Request processed in 42us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873774.832175:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788873774.832257:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859074048:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832285:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873774.832305:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859074560:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832325:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873774.832343:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788873774.832349:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859073920:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873774.832391:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859074432:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873774.832419:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859074944:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832437:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873774.832462:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859073920 00000100:00100000:1.0:1788873774.832466:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859073920 00000100:00100000:1.0:1788873774.832493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788873774.832499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859073920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832543:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859073920:12345-0@lo:400:kworker.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873774.832549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788873774.832564:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074048 00000100:00100000:1.0:1788873774.832568:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074048 00000100:00100000:1.0:1788873774.832589:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074560 00000100:00100000:1.0:1788873774.832592:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074560 00000100:00100000:1.0:1788873774.832604:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074432 00000100:00100000:1.0:1788873774.832606:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074432 00000100:00100000:1.0:1788873774.832620:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788873774.832626:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859074048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832655:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859074048:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873774.832661:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788873774.832672:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788873774.832678:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859074560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.832703:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859074560:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873774.832708:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788873774.832719:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788873774.833137:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859074432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.833170:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859074432:12345-0@lo:400:kworker.0 Request processed in 88us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873774.833176:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788873774.833249:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859073920:0@lo:400:kworker.0 00010000:00080000:1.0:1788873774.833262:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5b100 x1875769859074432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873774.833271:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859074432:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.833282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859074048:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.833290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859074560:0@lo:400:kworker.0 00000100:00100000:1.0:1788873774.833332:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859073664:0@lo:400:kworker.0 00000100:00100000:0.0:1788873774.833433:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859074944 00000100:00100000:0.0:1788873774.833438:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859074944 00000100:00100000:0.0:1788873774.833475:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788873774.833488:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873774.833539:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859074944:12345-0@lo:400:kworker.0 Request processed in 52us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873774.833546:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788873774.833566:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873774.833571:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873774.833573:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788873774.833589:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42ad80 x1875769859074944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873774.833598:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859074944:0@lo:400:kworker.0 00010000:00010000:0.0:1788873775.219021:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873775.344859:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859075072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873775.344938:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873775.345231:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075072 00000100:00100000:0.0:1788873775.345240:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075072 00000100:00100000:0.0:1788873775.345295:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788873775.345308:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859075072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873775.345337:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873775.345407:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859075072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873775.345415:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788873775.345707:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859075200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873775.345740:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873775.345824:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075200 00000100:00100000:3.0:1788873775.345828:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075200 00000100:00100000:3.0:1788873775.345862:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788873775.345870:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859075200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873775.345881:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873775.345914:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859075200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873775.345936:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788873775.345985:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abfb80 x1875769859075072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873775.346012:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859075072:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788873775.346135:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885c00 x1875769859075200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873775.346148:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859075200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873775.346683:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859075328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873775.346718:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873775.346848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075328 00000100:00100000:0.0:1788873775.346853:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075328 00000100:00100000:0.0:1788873775.346893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788873775.346902:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859075328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873775.346927:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873775.347031:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859075328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873775.347038:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788873775.347172:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859075328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873775.769541:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769617:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769649:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769677:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769699:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769732:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769761:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873775.769786:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122368 00000100:00100000:0.0:1788873775.769796:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122368 00000100:00100000:0.0:1788873775.769856:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122624 00000100:00100000:0.0:1788873775.769859:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122624 00000100:00100000:0.0:1788873775.769874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122240 00000100:00100000:0.0:1788873775.769876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122240 00000100:00100000:0.0:1788873775.769887:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122496 00000100:00100000:0.0:1788873775.769889:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122496 00000100:00100000:0.0:1788873775.769905:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 153 00000100:00100000:1.0:1788873775.770122:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 154 00000100:00100000:1.0:1788873775.770133:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122624:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873775.770253:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122624:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 122us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873775.770262:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 154 00000100:00100000:1.0:1788873775.770284:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 155 00000100:00100000:1.0:1788873775.770291:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840122240:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873775.770318:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840122240:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 28us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873775.770324:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 155 00000100:00100000:1.0:1788873775.770337:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 156 00000100:00100000:1.0:1788873775.770344:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122496:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873775.770369:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122496:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873775.770386:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 156 00000100:00100000:1.0:1788873775.770446:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122880 00000100:00100000:1.0:1788873775.770451:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122880 00000100:00100000:1.0:1788873775.770478:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122752 00000100:00100000:1.0:1788873775.770481:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122752 00000100:00100000:1.0:1788873775.770520:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:1.0:1788873775.770526:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122880:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873775.770555:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122880:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873775.770562:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:1.0:1788873775.770575:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:1.0:1788873775.770582:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122752:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873775.770604:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2400:x1875769840122752:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 23us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873775.770610:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00080000:1.0:1788873775.770644:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788873775.770648:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873775.770651:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873775.770653:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873775.771199:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840122368:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873775.771255:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840122368:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 1341us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873775.771263:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 153 00000100:00100000:3.0:1788873775.774739:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840122112 00000100:00100000:3.0:1788873775.774754:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840122112 00000100:00100000:3.0:1788873775.774957:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 306 00000100:00100000:3.0:1788873775.774967:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840122112:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873775.775053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840122112:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 88us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873775.775061:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 306 00000001:00100000:1.0:1788873775.858542:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00100000:0.0:1788873775.864268:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00100000:1.0:1788873775.864400:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00100000:1.0:1788873775.865224:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00010000:00010000:2.0:1788873776.240570:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788873776.270033:0:12184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788873777.264282:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873777.903392:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859075456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873777.903468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873777.903717:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075456 00000100:00100000:0.0:1788873777.903725:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075456 00000100:00100000:0.0:1788873777.903783:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788873777.903793:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859075456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873777.903832:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873777.903891:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859075456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873777.903906:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788873777.903956:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859075456:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873778.286526:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873779.311910:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873779.442892:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873779.442983:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.443789:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075584 00000100:00100000:3.0:1788873779.444559:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075584 00000100:00100000:3.0:1788873779.444631:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788873779.444783:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34770de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859075584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873779.444894:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873779.444991:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34770de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859075584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 351us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873779.444998:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788873779.445939:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873779.447763:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a36d80 x1875769859075584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873779.448932:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873779.449893:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873779.449911:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873779.450002:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873779.452228:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075712 00000100:00100000:2.0:1788873779.452243:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075712 00000100:00100000:2.0:1788873779.452312:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788873779.452416:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873779.452539:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873779.452691:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 370us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.452698:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788873779.455078:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873779.468525:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42b800 x1875769859075712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873779.468560:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873779.950815:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859076224:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.950900:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.950970:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859076736:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.950994:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951019:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788873779.951025:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859075840:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951053:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951075:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859076352:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951098:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951115:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859076864:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951135:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951161:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859075968:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951199:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859076480:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951275:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951294:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859076992:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951318:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951336:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788873779.951342:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859076096:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951362:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951380:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859076608:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873779.951417:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859077120:0@lo:400:kworker.0 00000100:00100000:3.0:1788873779.951435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873779.953255:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076224 00000100:00100000:2.0:1788873779.953274:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076224 00000100:00100000:2.0:1788873779.953327:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076736 00000100:00100000:2.0:1788873779.953330:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076736 00000100:00100000:2.0:1788873779.953358:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076864 00000100:00100000:2.0:1788873779.953361:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076864 00000100:00100000:2.0:1788873779.953372:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075968 00000100:00100000:2.0:1788873779.953375:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075968 00000100:00100000:2.0:1788873779.953385:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076480 00000100:00100000:2.0:1788873779.953388:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076480 00000100:00100000:2.0:1788873779.953401:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076608 00000100:00100000:2.0:1788873779.953403:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076608 00000100:00100000:2.0:1788873779.953419:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788873779.953428:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953526:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859076224:12345-0@lo:400:kworker.0 Request processed in 99us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953534:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788873779.953558:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788873779.953564:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953592:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859076736:12345-0@lo:400:kworker.0 Request processed in 29us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953598:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788873779.953610:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788873779.953616:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953642:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859076864:12345-0@lo:400:kworker.0 Request processed in 27us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953648:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788873779.953658:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788873779.953663:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859075968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953692:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859075968:12345-0@lo:400:kworker.0 Request processed in 29us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953698:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788873779.953710:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788873779.953716:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859076480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953742:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859076480:12345-0@lo:400:kworker.0 Request processed in 26us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953748:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788873779.953758:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788873779.953764:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859076608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953798:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859076608:12345-0@lo:400:kworker.0 Request processed in 34us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953804:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788873779.953829:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076352 00000100:00100000:2.0:1788873779.953833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076352 00000100:00100000:2.0:1788873779.953859:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076096 00000100:00100000:2.0:1788873779.953862:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076096 00000100:00100000:2.0:1788873779.953875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788873779.953881:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953916:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859076352:12345-0@lo:400:kworker.0 Request processed in 36us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788873779.953934:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788873779.953940:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.953978:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859076096:12345-0@lo:400:kworker.0 Request processed in 38us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.953984:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788873779.954005:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859075840 00000100:00100000:2.0:1788873779.954009:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859075840 00000100:00100000:2.0:1788873779.954043:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788873779.954050:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859075840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954080:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859075840:12345-0@lo:400:kworker.0 Request processed in 31us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.954086:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788873779.954142:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859076992 00000100:00100000:2.0:1788873779.954146:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859076992 00000100:00100000:2.0:1788873779.954170:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077120 00000100:00100000:2.0:1788873779.954178:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077120 00000100:00100000:2.0:1788873779.954199:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788873779.954231:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859076992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954264:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859076992:12345-0@lo:400:kworker.0 Request processed in 59us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.954270:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788873779.954282:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788873779.954287:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954313:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859077120:12345-0@lo:400:kworker.0 Request processed in 26us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873779.954319:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788873779.954365:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873779.954369:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873779.954371:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873779.954409:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859075840:0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954423:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859076352:0@lo:400:kworker.0 00010000:00080000:2.0:1788873779.954437:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abd500 x1875769859076864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873779.954448:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859076864:0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954460:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859076224:0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954469:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859076736:0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954513:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859076096:0@lo:400:kworker.0 00010000:00080000:2.0:1788873779.954525:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ead80 x1875769859076608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873779.954547:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859076608:0@lo:400:kworker.0 00010000:00080000:2.0:1788873779.954560:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abf100 x1875769859077120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873779.954568:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859077120:0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954579:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859075968:0@lo:400:kworker.0 00000100:00100000:2.0:1788873779.954589:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859076480:0@lo:400:kworker.0 00010000:00080000:2.0:1788873779.954599:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abce00 x1875769859076992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873779.954608:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859076992:0@lo:400:kworker.0 00010000:00010000:2.0:1788873780.335447:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873780.468239:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859077248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873780.468307:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873780.468364:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873780.468371:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859077376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873780.468398:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873780.468432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077376 00000100:00100000:3.0:1788873780.468440:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077376 00000100:00100000:3.0:1788873780.468482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788873780.468491:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859077376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873780.468525:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873780.468569:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859077376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873780.468576:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788873780.468684:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077248 00000100:00100000:1.0:1788873780.468688:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077248 00000100:00100000:1.0:1788873780.468719:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788873780.468725:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859077248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873780.468743:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873780.468788:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859077248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873780.468794:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788873780.468920:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859077376:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788873780.468934:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42e300 x1875769859077248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873780.468946:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859077248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873780.471420:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859077504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873780.471488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873780.471561:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077504 00000100:00100000:1.0:1788873780.471569:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077504 00000100:00100000:1.0:1788873780.471612:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788873780.471622:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859077504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873780.471644:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873780.471688:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859077504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873780.471695:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788873780.471741:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475d92a00 x1875769859077504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873780.471770:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859077504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873780.889255:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889290:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889315:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889338:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889357:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889395:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889687:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873780.889760:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123008 00000100:00100000:3.0:1788873780.889774:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123008 00000100:00100000:3.0:1788873780.889834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 308 00000100:00100000:3.0:1788873780.889844:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840123008:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873780.889920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840123008:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 76us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873780.889928:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 308 00000100:00100000:3.0:1788873780.889989:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123136 00000100:00100000:3.0:1788873780.889994:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123136 00000100:00100000:3.0:1788873780.890029:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123392 00000100:00100000:3.0:1788873780.890031:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123392 00000100:00100000:3.0:1788873780.890044:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123264 00000100:00100000:3.0:1788873780.890046:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123264 00000100:00100000:3.0:1788873780.890057:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123520 00000100:00100000:3.0:1788873780.890059:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123520 00000100:00100000:3.0:1788873780.890071:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 163 00000100:00100000:3.0:1788873780.890076:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840123136:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873780.890109:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840123136:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 33us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873780.890115:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 163 00000100:00100000:3.0:1788873780.890127:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 164 00000100:00100000:3.0:1788873780.890133:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840123392:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873780.890155:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840123392:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 22us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873780.890161:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 164 00000100:00100000:3.0:1788873780.890180:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 165 00000100:00100000:3.0:1788873780.890186:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840123264:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873780.890254:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840123264:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 67us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873780.890260:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 165 00000100:00100000:3.0:1788873780.890270:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 166 00000100:00100000:3.0:1788873780.890275:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840123520:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873780.890295:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840123520:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 20us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873780.890300:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 166 00000100:00100000:0.0:1788873780.899194:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123648 00000100:00100000:0.0:1788873780.899223:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123648 00000100:00100000:0.0:1788873780.899288:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123776 00000100:00100000:0.0:1788873780.899291:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123776 00000100:00100000:0.0:1788873780.899315:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:0.0:1788873780.899325:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840123648:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873780.899407:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840123648:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 84us (10067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873780.899414:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:0.0:1788873780.899431:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00100000:0.0:1788873780.899437:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840123776:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873780.899568:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840123776:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 130us (9881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873780.899575:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00080000:3.0:1788873780.903520:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873780.903532:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788873780.903536:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873780.903539:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788873781.360143:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873782.382513:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873783.028041:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873783.028065:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859077632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873783.028177:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873783.028268:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077632 00000100:00100000:1.0:1788873783.028276:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077632 00000100:00100000:1.0:1788873783.028325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788873783.028334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859077632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873783.028373:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788873783.028422:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859077632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873783.028429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788873783.028491:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859077632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873783.410308:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873784.433631:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873784.559116:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873784.559143:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859077760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873784.559287:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873784.559441:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077760 00000100:00100000:2.0:1788873784.559450:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077760 00000100:00100000:2.0:1788873784.559508:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788873784.559518:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859077760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873784.559546:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873784.559594:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859077760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873784.559601:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788873784.561310:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873784.561337:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:1.0:1788873784.561368:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f429180 x1875769859077760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873784.561391:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859077888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873784.561396:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859077760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873784.561487:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873784.561561:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859077888 00000100:00100000:1.0:1788873784.561568:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859077888 00000100:00100000:1.0:1788873784.561626:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788873784.561636:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859077888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788873784.561666:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873784.561708:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859077888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873784.561716:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788873784.561747:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42aa00 x1875769859077888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873784.561760:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859077888:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788873784.561829:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873785.070757:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873785.070823:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873785.070844:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859078144:0@lo:400:kworker.0 00000100:00100000:2.0:1788873785.070957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873785.071033:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078144 00000100:00100000:2.0:1788873785.071040:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078144 00000100:00100000:2.0:1788873785.071092:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788873785.071101:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859078144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873785.071154:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859078144:12345-0@lo:400:kworker.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873785.071161:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788873785.071232:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859078144:0@lo:400:kworker.0 00000100:00100000:3.0:1788873785.077788:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859078016:0@lo:400:kworker.0 00000100:00100000:3.0:1788873785.077883:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873785.078056:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078016 00000100:00100000:2.0:1788873785.078064:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078016 00000100:00100000:2.0:1788873785.078116:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788873785.078126:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859078016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873785.078181:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859078016:12345-0@lo:400:kworker.0 Request processed in 56us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873785.078188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788873785.078442:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859078016:0@lo:400:kworker.0 00000100:00100000:2.0:1788873785.080424:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859078272:0@lo:400:kworker.0 00000100:00100000:2.0:1788873785.080487:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873785.082136:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078272 00000100:00100000:3.0:1788873785.082150:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078272 00000100:00100000:3.0:1788873785.082231:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788873785.082241:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859078272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873785.084245:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859078272:12345-0@lo:400:kworker.0 Request processed in 1998us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873785.084259:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788873785.084582:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859078400:0@lo:400:kworker.0 00000100:00100000:1.0:1788873785.084647:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873785.084808:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078400 00000100:00100000:3.0:1788873785.084815:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078400 00000100:00100000:3.0:1788873785.084868:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788873785.084877:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859078400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873785.084950:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859078400:12345-0@lo:400:kworker.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873785.084967:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788873785.085008:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859078400:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085356:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859078656:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.085422:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859079168:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.085462:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788873785.085468:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859078528:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085489:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.085517:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859079040:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.085709:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859079552:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085731:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.085759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078656 00000100:00100000:0.0:1788873785.085764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078656 00000100:00100000:0.0:1788873785.085801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079168 00000100:00100000:0.0:1788873785.085804:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079168 00000100:00100000:0.0:1788873785.085824:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788873785.085831:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859078656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085866:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859078656:12345-0@lo:400:kworker.0 Request processed in 37us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873785.085873:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788873785.085885:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788873785.085891:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859079168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.085927:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859079168:12345-0@lo:400:kworker.0 Request processed in 37us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873785.085933:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788873785.085950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078528 00000100:00100000:0.0:1788873785.085953:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078528 00000100:00100000:0.0:1788873785.086047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788873785.086053:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859078528:12345-0@lo:400:kworker.0 Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873785.086096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788873785.086112:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079040 00000100:00100000:0.0:1788873785.086115:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079040 00000100:00100000:0.0:1788873785.086146:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079552 00000100:00100000:0.0:1788873785.086149:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079552 00000100:00100000:0.0:1788873785.086167:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788873785.086172:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859079040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086241:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859079040:12345-0@lo:400:kworker.0 Request processed in 32us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873785.086248:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788873785.086260:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788873785.086265:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859079552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086292:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859079552:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873785.086298:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788873785.086316:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873785.086320:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873785.086350:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859078528:0@lo:400:kworker.0 00010000:00080000:0.0:1788873785.086364:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a36680 x1875769859079040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873785.086375:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859079040:0@lo:400:kworker.0 00010000:00080000:0.0:1788873785.086385:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a35f80 x1875769859079552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873785.086393:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859079552:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086476:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859078656:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086489:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859079168:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086517:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859078912:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086656:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.086679:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859079424:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086700:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.086717:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788873785.086723:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859078784:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086744:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.086760:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859079296:0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086778:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873785.086800:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078912 00000100:00100000:0.0:1788873785.086804:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078912 00000100:00100000:0.0:1788873785.086826:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079424 00000100:00100000:0.0:1788873785.086829:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079424 00000100:00100000:0.0:1788873785.086852:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788873785.086858:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859078912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086889:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859078912:12345-0@lo:400:kworker.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873785.086895:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788873785.086906:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788873785.086923:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859079424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873785.086949:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859079424:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873785.087073:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859078784 00000100:00100000:1.0:1788873785.087078:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859078784 00000100:00100000:1.0:1788873785.087099:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079296 00000100:00100000:1.0:1788873785.087102:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079296 00000100:00100000:1.0:1788873785.087116:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788873785.087122:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859078784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873785.087156:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859078784:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873785.087161:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788873785.087174:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788873785.087180:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859079296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873785.087219:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859079296:12345-0@lo:400:kworker.0 Request processed in 40us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873785.087225:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788873785.087277:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788873785.087298:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873785.087301:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788873785.087323:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a34a80 x1875769859078784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873785.087332:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859078784:0@lo:400:kworker.0 00010000:00080000:0.0:1788873785.087352:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a35500 x1875769859079296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873785.087360:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859079296:0@lo:400:kworker.0 00010000:00080000:0.0:1788873785.087369:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a36300 x1875769859078912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873785.087376:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859078912:0@lo:400:kworker.0 00010000:00080000:0.0:1788873785.087385:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a34e00 x1875769859079424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873785.087392:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859079424:0@lo:400:kworker.0 00000100:00100000:2.0:1788873785.087830:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859078272:0@lo:400:kworker.0 00000020:00000004:3.0:1788873785.357884:0:12500:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873785.358697:0:12500:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788873785.454348:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873785.584701:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873785.584725:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873785.584812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873785.584895:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079680 00000100:00100000:3.0:1788873785.584916:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079680 00000100:00100000:3.0:1788873785.584966:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788873785.584975:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859079680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873785.585005:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873785.585052:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859079680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873785.585059:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788873785.585100:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59880 x1875769859079680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873785.585121:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873785.588433:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859079936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873785.588523:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873785.588607:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873785.588615:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859079808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873785.588644:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873785.588681:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079936 00000100:00100000:1.0:1788873785.588689:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079936 00000100:00100000:1.0:1788873785.588735:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788873785.588743:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859079936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873785.588768:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873785.588812:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859079936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873785.588819:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788873785.588859:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475d90000 x1875769859079936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873785.588879:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859079936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873785.589162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859079808 00000100:00100000:3.0:1788873785.589168:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859079808 00000100:00100000:3.0:1788873785.589229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788873785.589254:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859079808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873785.589282:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873785.589376:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859079808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873785.589382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788873785.589504:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859079808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873786.001766:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001798:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001832:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001858:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001876:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001894:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001929:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873786.001958:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840123904 00000100:00100000:3.0:1788873786.001967:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840123904 00000100:00100000:3.0:1788873786.002031:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 310 00000100:00100000:3.0:1788873786.002042:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840123904:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873786.002228:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124032 00000100:00100000:1.0:1788873786.002233:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124032 00000100:00100000:1.0:1788873786.002271:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124288 00000100:00100000:1.0:1788873786.002274:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124288 00000100:00100000:1.0:1788873786.002288:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124160 00000100:00100000:1.0:1788873786.002290:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124160 00000100:00100000:1.0:1788873786.002302:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124416 00000100:00100000:1.0:1788873786.002304:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124416 00000100:00100000:1.0:1788873786.002320:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 173 00000100:00100000:1.0:1788873786.002327:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840124032:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873786.002400:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840123904:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 359us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873786.002407:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 310 00000100:00100000:0.0:1788873786.002493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 174 00000100:00100000:0.0:1788873786.002503:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124288:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873786.003102:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840124032:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 773us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873786.003119:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 173 00000100:00100000:1.0:1788873786.003149:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 175 00000100:00100000:1.0:1788873786.003156:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840124160:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873786.003184:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840124160:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 29us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873786.003189:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 175 00000100:00100000:1.0:1788873786.003200:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 176 00000100:00100000:1.0:1788873786.003237:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124416:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873786.003262:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124416:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873786.003268:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 176 00000100:00100000:1.0:1788873786.003457:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124544 00000100:00100000:1.0:1788873786.003463:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124544 00000100:00100000:1.0:1788873786.003500:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124672 00000100:00100000:1.0:1788873786.003503:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124672 00000100:00100000:1.0:1788873786.003521:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:1.0:1788873786.003526:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124544:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873786.003551:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124544:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873786.003557:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:1.0:1788873786.003568:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:1.0:1788873786.003574:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124672:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873786.003598:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124672:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873786.003604:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:0.0:1788873786.006978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840124288:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 4466us (5167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873786.006995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 174 00000100:00080000:1.0:1788873786.007377:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873786.007383:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788873786.007387:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873786.007401:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788873786.481249:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788873787.352697:0:12597:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873787.353913:0:12597:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788873787.502788:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873788.143301:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873788.143339:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859080064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873788.143446:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873788.143550:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080064 00000100:00100000:0.0:1788873788.143571:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080064 00000100:00100000:0.0:1788873788.143637:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788873788.143648:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859080064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873788.143698:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873788.143766:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859080064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873788.143775:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788873788.143852:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859080064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873788.530105:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788873789.216813:0:12695:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873789.217058:0:12695:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788873789.555965:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873789.681848:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873789.681892:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859080192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873789.681990:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873789.682081:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080192 00000100:00100000:3.0:1788873789.682103:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080192 00000100:00100000:3.0:1788873789.682176:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788873789.682189:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859080192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873789.682259:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873789.682316:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859080192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873789.682324:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788873789.682350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873789.682401:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f44f800 x1875769859080192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873789.682424:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859080192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873789.683056:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859080320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873789.683109:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873789.683368:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080320 00000100:00100000:3.0:1788873789.683376:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080320 00000100:00100000:3.0:1788873789.683441:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788873789.683450:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859080320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873789.683468:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788873789.683526:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873789.688526:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859080320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5060us (5401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873789.688546:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788873789.689625:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a34e00 x1875769859080320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873789.689653:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859080320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873790.190650:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859080448:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.191184:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.191268:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859080960:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.191297:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.191317:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859081472:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.191338:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873790.191462:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080448 00000100:00100000:1.0:1788873790.191471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080448 00000100:00100000:1.0:1788873790.191525:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788873790.191534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859080448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873790.191597:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859080448:12345-0@lo:400:kworker.0 Request processed in 65us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873790.191604:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788873790.191638:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081472 00000100:00100000:1.0:1788873790.191642:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081472 00000100:00100000:1.0:1788873790.191670:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788873790.191677:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859081472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873790.191719:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859081472:12345-0@lo:400:kworker.0 Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873790.191726:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788873790.191883:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0aa00 x1875769859081472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873790.191900:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859081472:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.191908:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859081984:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.191935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.191981:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859080448:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.191991:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788873790.191997:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859080832:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192021:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192038:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859081344:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192059:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192077:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859081856:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192102:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192145:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192168:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192183:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859081088:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192227:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192244:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859081600:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192264:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192284:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788873790.192290:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859080704:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192311:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.192327:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859081216:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.192348:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.194967:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859081728:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195029:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873790.195072:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080960 00000100:00100000:0.0:1788873790.195082:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080960 00000100:00100000:0.0:1788873790.195138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080704 00000100:00100000:0.0:1788873790.195141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080704 00000100:00100000:0.0:1788873790.195160:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788873790.195169:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859080960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859080960:12345-0@lo:400:kworker.0 Request processed in 78us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788873790.195272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788873790.195278:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859080704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859080704:12345-0@lo:400:kworker.0 Request processed in 35us (3000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788873790.195350:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081984 00000100:00100000:0.0:1788873790.195354:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081984 00000100:00100000:0.0:1788873790.195384:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081344 00000100:00100000:0.0:1788873790.195387:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081344 00000100:00100000:0.0:1788873790.195399:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081856 00000100:00100000:0.0:1788873790.195401:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081856 00000100:00100000:0.0:1788873790.195418:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788873790.195424:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859081984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195462:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859081984:12345-0@lo:400:kworker.0 Request processed in 38us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195468:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788873790.195479:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788873790.195484:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859081344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195511:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859081344:12345-0@lo:400:kworker.0 Request processed in 27us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195517:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788873790.195527:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788873790.195534:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859081856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195561:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859081856:12345-0@lo:400:kworker.0 Request processed in 28us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195567:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788873790.195585:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080832 00000100:00100000:0.0:1788873790.195589:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080832 00000100:00100000:0.0:1788873790.195608:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859080576 00000100:00100000:0.0:1788873790.195611:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859080576 00000100:00100000:0.0:1788873790.195623:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081088 00000100:00100000:0.0:1788873790.195632:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081088 00000100:00100000:0.0:1788873790.195650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081600 00000100:00100000:0.0:1788873790.195653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081600 00000100:00100000:0.0:1788873790.195664:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081216 00000100:00100000:0.0:1788873790.195668:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081216 00000100:00100000:0.0:1788873790.195680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859081728 00000100:00100000:0.0:1788873790.195682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859081728 00000100:00100000:0.0:1788873790.195698:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788873790.195703:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859080832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195738:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859080832:12345-0@lo:400:kworker.0 Request processed in 35us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195744:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788873790.195755:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788873790.195760:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859080576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195790:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859080576:12345-0@lo:400:kworker.0 Request processed in 30us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788873790.195807:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788873790.195813:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859081088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195840:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859081088:12345-0@lo:400:kworker.0 Request processed in 27us (3636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195845:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788873790.195855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788873790.195874:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859081600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195902:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859081600:12345-0@lo:400:kworker.0 Request processed in 41us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788873790.195926:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788873790.195932:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859081216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.195961:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859081216:12345-0@lo:400:kworker.0 Request processed in 29us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.195967:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788873790.195977:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788873790.195983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859081728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.196008:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859081728:12345-0@lo:400:kworker.0 Request processed in 26us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873790.196014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788873790.196069:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859080704:0@lo:400:kworker.0 00010000:00080000:0.0:1788873790.196086:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0b800 x1875769859081216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873790.196096:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859081216:0@lo:400:kworker.0 00010000:00080000:0.0:1788873790.196105:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0bb80 x1875769859081728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873790.196113:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859081728:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.196123:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.196132:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859081088:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.196141:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859081600:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.196180:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859080832:0@lo:400:kworker.0 00010000:00080000:0.0:1788873790.196192:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a09180 x1875769859081344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873790.196231:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859081344:0@lo:400:kworker.0 00010000:00080000:0.0:1788873790.196244:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a08a80 x1875769859081856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873790.196252:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859081856:0@lo:400:kworker.0 00000100:00100000:0.0:1788873790.196262:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859080960:0@lo:400:kworker.0 00010000:00080000:0.0:1788873790.196271:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0a300 x1875769859081984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873790.196279:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859081984:0@lo:400:kworker.0 00000100:00080000:1.0:1788873790.196468:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873790.196473:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873790.196475:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788873790.575807:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873790.703034:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859082112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873790.703108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873790.704939:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873790.704954:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859082240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873790.705005:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873790.708158:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859082368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873790.708247:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873790.708321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082368 00000100:00100000:1.0:1788873790.708329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082368 00000100:00100000:1.0:1788873790.708387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788873790.708397:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859082368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873790.708433:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873790.708493:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859082368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873790.708500:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788873790.708561:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859082368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873790.714227:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082112 00000100:00100000:2.0:1788873790.714243:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082112 00000100:00100000:2.0:1788873790.714314:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082240 00000100:00100000:2.0:1788873790.714318:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082240 00000100:00100000:2.0:1788873790.714346:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788873790.714357:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859082112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873790.714407:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873790.714526:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859082112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (11417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873790.714535:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788873790.714573:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788873790.714580:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859082240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788873790.714592:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873790.714622:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859082240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (9617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873790.714628:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788873790.714674:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f44f800 x1875769859082240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873790.714715:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859082240:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788873790.714732:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42a680 x1875769859082112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873790.714742:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859082112:0@lo:13:osp-pre-1-1.0 00000020:00000004:2.0:1788873791.096342:0:12792:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873791.096575:0:12792:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788873791.118669:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118713:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118739:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118760:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118779:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118801:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118824:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873791.118866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125056 00000100:00100000:2.0:1788873791.118876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125056 00000100:00100000:2.0:1788873791.118935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125312 00000100:00100000:2.0:1788873791.118938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125312 00000100:00100000:2.0:1788873791.118952:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124928 00000100:00100000:2.0:1788873791.118955:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124928 00000100:00100000:2.0:1788873791.118967:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125184 00000100:00100000:2.0:1788873791.118969:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125184 00000100:00100000:2.0:1788873791.118986:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 183 00000100:00100000:2.0:1788873791.118994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840125056:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873791.119067:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840125056:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873791.119074:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 183 00000100:00100000:2.0:1788873791.119111:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 184 00000100:00100000:2.0:1788873791.119118:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840125312:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873791.119144:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840125312:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873791.119150:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 184 00000100:00100000:2.0:1788873791.119163:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 185 00000100:00100000:2.0:1788873791.119169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840124928:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873791.119191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840124928:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 23us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873791.119197:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 185 00000100:00100000:2.0:1788873791.119236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 186 00000100:00100000:2.0:1788873791.119243:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840125184:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873791.119267:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840125184:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873791.119272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 186 00000100:00100000:2.0:1788873791.119319:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125440 00000100:00100000:2.0:1788873791.119323:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125440 00000100:00100000:0.0:1788873791.120479:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840124800 00000100:00100000:0.0:1788873791.120486:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840124800 00000100:00100000:0.0:1788873791.120521:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 312 00000100:00100000:0.0:1788873791.120527:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840124800:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873791.120565:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840124800:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 38us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873791.120572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 312 00000100:00100000:2.0:1788873791.120713:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125568 00000100:00100000:2.0:1788873791.120717:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125568 00000100:00100000:2.0:1788873791.120752:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:2.0:1788873791.120759:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2397:x1875769840125440:12345-192.168.202.20@tcp:9:kworker.0 00000020:00000080:2.0:1788873791.120780:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b703 00000100:00080000:2.0:1788873791.120788:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d3342b96000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788873791.120829:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788873791.120952:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+2:2397:x1875769840125440:12345-192.168.202.20@tcp:9:kworker.0 Request processed in 192us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873791.120965:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:2.0:1788873791.120981:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:2.0:1788873791.120986:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2397:x1875769840125568:12345-192.168.202.20@tcp:9:kworker.0 00000020:00000080:2.0:1788873791.120996:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b70a 00000100:00080000:2.0:1788873791.121001:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d347a75d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788873791.121023:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788873791.121081:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+2:2397:x1875769840125568:12345-192.168.202.20@tcp:9:kworker.0 Request processed in 94us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873791.121087:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00080000:2.0:1788873791.121108:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873791.121112:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788873791.121114:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788873791.121116:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788873791.126016:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873791.126026:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873791.606360:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873792.627727:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788873793.076940:0:12889:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873793.077771:0:12889:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788873793.262842:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859082496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873793.262909:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873793.263128:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082496 00000100:00100000:0.0:1788873793.263136:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082496 00000100:00100000:0.0:1788873793.263185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788873793.263194:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859082496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873793.263250:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873793.263309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859082496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873793.263315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788873793.263367:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859082496:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873793.659163:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873794.670535:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873794.798801:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859082624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873794.798910:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873794.799252:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082624 00000100:00100000:1.0:1788873794.799264:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082624 00000100:00080000:2.0:1788873794.799765:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873794.799889:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859082752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873794.799942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873794.799980:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082752 00000100:00100000:1.0:1788873794.799986:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082752 00000100:00100000:2.0:1788873794.800000:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788873794.800011:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859082624:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873794.800013:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788873794.800019:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859082752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873794.800050:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788873794.800050:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873794.800103:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859082624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873794.800121:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1788873794.800173:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42b100 x1875769859082624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873794.800197:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859082624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788873794.800258:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873794.801668:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859082752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1638us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873794.801681:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788873794.803167:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42aa00 x1875769859082752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873794.803200:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859082752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873795.315074:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859083008:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315183:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315284:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859083520:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315335:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859084032:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315359:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315388:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788873795.315394:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859082880:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315426:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315452:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859083392:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315479:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315500:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859083904:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315557:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315581:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859084416:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315604:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315636:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859083136:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315662:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315684:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859083648:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315737:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859084160:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315777:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788873795.315782:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859083264:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315804:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315829:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859083776:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315870:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859084288:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.315890:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873795.315926:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083008 00000100:00100000:2.0:1788873795.315938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083008 00000100:00100000:2.0:1788873795.315992:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083520 00000100:00100000:2.0:1788873795.315995:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083520 00000100:00100000:2.0:1788873795.316024:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084032 00000100:00100000:2.0:1788873795.316027:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084032 00000100:00100000:2.0:1788873795.316040:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083648 00000100:00100000:2.0:1788873795.316042:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083648 00000100:00100000:2.0:1788873795.316054:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084160 00000100:00100000:2.0:1788873795.316056:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084160 00000100:00100000:2.0:1788873795.316066:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083264 00000100:00100000:2.0:1788873795.316069:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083264 00000100:00100000:2.0:1788873795.316086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788873795.316096:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859083008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316164:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859083008:12345-0@lo:400:kworker.0 Request processed in 68us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316172:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788873795.316201:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788873795.316244:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859083520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316278:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859083520:12345-0@lo:400:kworker.0 Request processed in 36us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316285:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788873795.316299:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788873795.316305:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859084032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316333:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859084032:12345-0@lo:400:kworker.0 Request processed in 29us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316339:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788873795.316352:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788873795.316357:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859083648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316392:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859083648:12345-0@lo:400:kworker.0 Request processed in 35us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316398:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788873795.316411:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788873795.316417:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859084160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316443:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859084160:12345-0@lo:400:kworker.0 Request processed in 27us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788873795.316456:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788873795.316459:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859083264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316475:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859083264:12345-0@lo:400:kworker.0 Request processed in 16us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788873795.316502:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859082880 00000100:00100000:2.0:1788873795.316510:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859082880 00000100:00100000:2.0:1788873795.316535:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788873795.316539:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859082880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316561:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859082880:12345-0@lo:400:kworker.0 Request processed in 23us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316565:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788873795.316593:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083392 00000100:00100000:2.0:1788873795.316597:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083392 00000100:00100000:2.0:1788873795.316627:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083136 00000100:00100000:2.0:1788873795.316630:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083136 00000100:00100000:2.0:1788873795.316644:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788873795.316648:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859083392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316674:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859083392:12345-0@lo:400:kworker.0 Request processed in 26us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316678:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788873795.316686:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788873795.316689:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859083136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316721:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859083136:12345-0@lo:400:kworker.0 Request processed in 31us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316725:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788873795.316741:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083904 00000100:00100000:2.0:1788873795.316743:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083904 00000100:00100000:2.0:1788873795.316757:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084416 00000100:00100000:2.0:1788873795.316759:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084416 00000100:00100000:2.0:1788873795.316770:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859083776 00000100:00100000:2.0:1788873795.316773:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859083776 00000100:00100000:2.0:1788873795.316783:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084288 00000100:00100000:2.0:1788873795.316785:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084288 00000100:00100000:2.0:1788873795.316798:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788873795.316829:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859083904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316865:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859083904:12345-0@lo:400:kworker.0 Request processed in 53us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316871:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788873795.316884:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788873795.316893:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859084416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316919:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859084416:12345-0@lo:400:kworker.0 Request processed in 27us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316925:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788873795.316935:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788873795.316940:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859083776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.316966:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859083776:12345-0@lo:400:kworker.0 Request processed in 26us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.316971:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788873795.316983:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788873795.316988:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859084288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.317013:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859084288:12345-0@lo:400:kworker.0 Request processed in 25us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873795.317019:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788873795.317068:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873795.317075:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873795.317077:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873795.317126:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859083264:0@lo:400:kworker.0 00010000:00080000:2.0:1788873795.317144:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8380 x1875769859083776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873795.317169:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859083776:0@lo:400:kworker.0 00010000:00080000:2.0:1788873795.317183:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1e300 x1875769859084288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873795.317192:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859084288:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.321922:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859083136:0@lo:400:kworker.0 00010000:00080000:2.0:1788873795.322000:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427ead80 x1875769859083648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873795.322015:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859083648:0@lo:400:kworker.0 00010000:00080000:2.0:1788873795.322032:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abd500 x1875769859084160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873795.322043:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859084160:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.322142:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859082880:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.322158:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859083392:0@lo:400:kworker.0 00010000:00080000:2.0:1788873795.322174:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abce00 x1875769859083904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873795.322183:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859083904:0@lo:400:kworker.0 00010000:00080000:2.0:1788873795.322197:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b1d880 x1875769859084416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873795.322226:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859084416:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.322243:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859083008:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.322274:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859083520:0@lo:400:kworker.0 00000100:00100000:2.0:1788873795.322288:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859084032:0@lo:400:kworker.0 00010000:00010000:2.0:1788873795.694564:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873795.825317:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859084544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873795.825425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873795.825541:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859084672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873795.825573:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873795.825616:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084544 00000100:00100000:3.0:1788873795.825626:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084544 00000100:00100000:3.0:1788873795.825689:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788873795.825699:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859084544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873795.825760:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873795.825826:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859084544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873795.825834:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788873795.825860:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084672 00000100:00100000:3.0:1788873795.825864:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084672 00000100:00100000:3.0:1788873795.825894:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788873795.825901:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859084672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873795.825925:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873795.825962:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859084672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873795.825969:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788873795.826062:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f44f800 x1875769859084672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873795.826084:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859084672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873795.826121:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859084544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873795.827125:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859084800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873795.827185:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873795.827273:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084800 00000100:00100000:1.0:1788873795.827280:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084800 00000100:00100000:1.0:1788873795.827346:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788873795.827354:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859084800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873795.827396:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873795.827441:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859084800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873795.827449:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788873795.827494:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885f80 x1875769859084800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873795.827513:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859084800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873796.240750:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873796.240791:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873796.240836:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873796.240862:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873796.240890:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873796.240926:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125824 00000100:00100000:1.0:1788873796.240939:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125824 00000100:00100000:1.0:1788873796.241014:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126080 00000100:00100000:1.0:1788873796.241017:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126080 00000100:00100000:1.0:1788873796.241032:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125952 00000100:00100000:1.0:1788873796.241035:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125952 00000100:00100000:1.0:1788873796.241047:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126208 00000100:00100000:1.0:1788873796.241050:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126208 00000100:00100000:1.0:1788873796.241069:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 193 00000100:00100000:1.0:1788873796.241080:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840125824:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873796.241178:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840125824:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 99us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873796.241185:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 193 00000100:00100000:1.0:1788873796.241235:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 194 00000100:00100000:1.0:1788873796.241242:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840126080:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873796.241294:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840126080:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873796.243438:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 194 00000100:00100000:1.0:1788873796.243953:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 195 00000100:00100000:1.0:1788873796.243973:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840125952:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873796.244075:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840125952:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 111us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873796.244082:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 195 00000100:00100000:1.0:1788873796.244100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 196 00000100:00100000:1.0:1788873796.244107:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840126208:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873796.244132:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840126208:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 26us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873796.244138:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 196 00000100:00100000:1.0:1788873796.244171:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840125696 00000100:00100000:1.0:1788873796.244181:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840125696 00000100:00100000:1.0:1788873796.244260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 314 00000100:00100000:1.0:1788873796.244267:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840125696:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873796.244294:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840125696:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 28us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873796.245776:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 314 00000100:00080000:1.0:1788873796.245861:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873796.245869:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788873796.569907:0:13034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788873796.722444:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788873796.848742:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000020:00000080:0.0:1788873796.848759:0:8420:0:(genops.c:885:class_export_put()) final put ffff9d3342b94800/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000020:00000080:2.0:1788873796.856470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3342b94800/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 for lustre-OST0000 00000020:00000080:2.0:1788873796.856615:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3342b96000 for lustre-OST0000 00000001:00100000:2.0:1788873796.856670:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000020:00000080:2.0:1788873796.856676:0:9507:0:(genops.c:885:class_export_put()) final put ffff9d347a75c000/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000020:00000080:2.0:1788873796.856699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a75c000/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 for lustre-OST0001 00000020:00000080:2.0:1788873796.856725:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d347a75d000 for lustre-OST0001 00010000:00010000:2.0:1788873797.746056:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873798.383333:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873798.383360:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859084928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873798.383444:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873798.383860:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859084928 00000100:00100000:2.0:1788873798.383938:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859084928 00000100:00100000:2.0:1788873798.384066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788873798.384077:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859084928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873798.384116:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788873798.384186:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859084928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873798.384193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788873798.384270:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859084928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788873798.767065:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788873799.562104:0:13182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe51555a80 20000000:00000080:3.0:1788873799.562128:0:13182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347a6a6c00 uarg=0000000000000000 20000000:01000000:3.0:1788873799.562182:0:13182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788873799.562189:0:13182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788873799.562194:0:13182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788873799.562710:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788873799.562946:0:13182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788873799.567599:0:13182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788873799.567635:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567652:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567659:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567663:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567667:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567670:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567674:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567679:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567718:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567749:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 12 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.567762:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085056:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873799.567898:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.567906:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.567913:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085184:0@lo:104: 00000100:00100000:3.0:1788873799.567954:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873799.568007:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.568013:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 23 pid: 6503 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.568018:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085312:0@lo:104: 00000100:00100000:3.0:1788873799.568032:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873799.568045:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.568049:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 23 pid: 6506 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.568054:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085440:0@lo:104: 00000100:00100000:3.0:1788873799.568064:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873799.568082:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.568087:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.568092:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085568:0@lo:104: 00000100:00100000:3.0:1788873799.568105:0:13182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788873799.568115:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.568119:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.568124:0:13182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085696:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873799.568138:0:13182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873799.568197:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859085184 00000100:00100000:0.0:1788873799.568233:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859085184 00000100:00100000:0.0:1788873799.568279:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859085312 00000100:00100000:0.0:1788873799.568282:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859085312 00000100:00100000:0.0:1788873799.568293:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859085440 00000100:00100000:0.0:1788873799.568295:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859085440 00000100:00100000:0.0:1788873799.568302:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859085568 00000100:00100000:0.0:1788873799.568305:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859085568 00000100:00100000:0.0:1788873799.568316:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788873799.568324:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:13182:x1875769859085184:12345-0@lo:104: 00010000:00010000:0.0:1788873799.568337:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568382:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873799.568387:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:13182:x1875769859085184:12345-0@lo:104: Request processed in 64us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.568396:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788873799.568411:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788873799.568414:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:13182:x1875769859085312:12345-0@lo:104: 00010000:00010000:0.0:1788873799.568420:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568444:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788873799.568448:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:13182:x1875769859085312:12345-0@lo:104: Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.568451:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788873799.568458:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873799.568462:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:13182:x1875769859085440:12345-0@lo:104: 00010000:00010000:0.0:1788873799.568466:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568483:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788873799.568486:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:13182:x1875769859085440:12345-0@lo:104: Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.568489:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873799.568495:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873799.568498:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:13182:x1875769859085568:12345-0@lo:104: 00010000:00010000:0.0:1788873799.568502:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568519:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788873799.568522:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:13182:x1875769859085568:12345-0@lo:104: Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.568530:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788873799.568545:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788873799.568550:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568556:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e200 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873799.568559:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568565:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873799.568569:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873799.568573:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873799.568593:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568598:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873799.568610:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568615:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215e200/0x25c660afb0a9b6d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568625:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788873799.568627:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568637:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873799.568639:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568643:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873799.568646:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873799.568649:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873799.568657:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568661:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873799.568672:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568676:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f442e00/0x25c660afb0a9b6c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568681:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788873799.568683:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568686:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873799.568688:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568699:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873799.568703:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873799.568706:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873799.568713:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568716:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873799.568719:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568723:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215ee00/0x25c660afb0a9b6b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568727:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873799.568729:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568732:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873799.568733:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568737:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873799.568740:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873799.568746:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873799.568754:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568757:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873799.568760:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568764:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92000/0x25c660afb0a9b6a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b6af expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.568914:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873799.568916:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873799.568917:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873799.568923:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873799.568927:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873799.568931:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873799.568950:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859085824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.568984:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873799.569003:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873799.569007:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859086208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.569021:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873799.569037:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859085952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.569050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873799.569059:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873799.569061:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859086080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.569070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873799.569093:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859085824 00000100:00100000:0.0:1788873799.569096:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859085824 00010000:00010000:0.0:1788873799.569110:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 24 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873799.569120:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086208 00000100:00100000:0.0:1788873799.569122:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086208 00010000:00010000:0.0:1788873799.569127:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 25 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873799.569132:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859085952 00000100:00100000:0.0:1788873799.569133:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859085952 00010000:00010000:0.0:1788873799.569138:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 26 pid: 6503 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873799.569142:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086080 00000100:00100000:0.0:1788873799.569143:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086080 00010000:00010000:0.0:1788873799.569148:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 27 pid: 6506 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873799.569155:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873799.569158:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+27:3634:x1875769859085824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873799.569166:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873799.569169:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 27 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569176:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 27 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569188:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873799.569229:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+27:3634:x1875769859085824:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.569245:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873799.569259:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873799.569266:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+26:3634:x1875769859086208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873799.569273:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873799.569278:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 26 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569286:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 26 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569295:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873799.569317:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+26:3634:x1875769859086208:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.569323:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873799.569334:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873799.569339:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3635:x1875769859085952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873799.569358:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873799.569361:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 25 pid: 6503 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569366:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 25 pid: 6503 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569372:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873799.569391:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3635:x1875769859085952:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.569395:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873799.569404:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873799.569412:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859086080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873799.569417:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873799.569420:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 24 pid: 6506 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569425:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 24 pid: 6506 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.569431:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873799.569444:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859086080:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.569447:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873799.569474:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859086080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.569479:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859085952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.569494:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859086208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873799.569498:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859085824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788873799.569798:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443200/0x25c660afb0a9b6d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b6d2 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.569809:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085184:0@lo:104: 00010000:00010000:3.0:1788873799.569818:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b6cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b6c4 expref: 22 pid: 6503 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.569826:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085312:0@lo:104: 00010000:00010000:3.0:1788873799.569835:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfea600/0x25c660afb0a9b6bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b6b6 expref: 21 pid: 6506 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.569843:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085440:0@lo:104: 00010000:00010000:3.0:1788873799.569851:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b6af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b6a8 expref: 20 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.569866:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085568:0@lo:104: 00000100:00100000:1.0:1788873799.574580:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873799.574644:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126336 00000100:00100000:0.0:1788873799.574652:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126336 00010000:00010000:0.0:1788873799.574689:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 13 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873799.574732:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:0.0:1788873799.574741:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840126336:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873799.574756:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873799.574762:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 13 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.574806:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 13 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873799.574828:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873799.574880:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840126336:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 140us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873799.574888:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 44 00010000:00010000:3.0:1788873799.575022:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeae00/0x25c660afb0a9b6ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a954f expref: 12 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873799.575038:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085056:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873799.575048:0:13182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1875769859085696:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873799.575082:0:13182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873799.577439:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873799.577540:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126464 00000100:00100000:1.0:1788873799.577565:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126464 00010000:00010000:1.0:1788873799.577604:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873799.577649:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:1.0:1788873799.577660:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458496450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:2401:x1875769840126464:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873799.577675:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873799.577681:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577694:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577711:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443c00/0x25c660afb0a9b6a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9510 expref: 12 pid: 6505 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577726:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577735:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577753:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577760:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577767:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577802:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577808:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788873799.577813:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577832:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577853:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873799.577865:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873799.577888:0:13182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.577897:0:13182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873799.577903:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b711 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873799.577927:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458496450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:2401:x1875769840126464:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 268us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873799.577941:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 45 00010000:00010000:3.0:1788873799.790712:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873799.918830:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873799.918856:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859086336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873799.918956:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873799.919088:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086336 00000100:00100000:2.0:1788873799.919097:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086336 00000100:00100000:2.0:1788873799.919162:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788873799.919175:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859086336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873799.919244:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873799.919297:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859086336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873799.919321:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788873799.920153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873799.920160:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b2ed80 x1875769859086336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873799.920184:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859086336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873799.920568:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873799.920581:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859086464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873799.920637:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873799.920765:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086464 00000100:00100000:3.0:1788873799.920792:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086464 00000100:00100000:3.0:1788873799.920847:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788873799.920855:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859086464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873799.920873:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873799.920938:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859086464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873799.920945:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788873799.921069:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b2c000 x1875769859086464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873799.921083:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859086464:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788873799.921231:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873800.430874:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859086592:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.430951:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431006:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859087104:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431056:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859087616:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431088:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431105:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859088128:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431148:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788873800.431154:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859086976:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431178:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431196:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431269:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859088000:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431443:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086976 00000100:00100000:1.0:1788873800.431451:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086976 00000100:00100000:1.0:1788873800.431499:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788873800.431507:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859086976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431556:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859086976:12345-0@lo:400:kworker.0 Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873800.431563:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788873800.431610:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859086976:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431651:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859086720:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431675:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431692:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859087232:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431710:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.431726:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859087744:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.431742:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873800.431883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086592 00000100:00100000:2.0:1788873800.431888:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086592 00000100:00100000:2.0:1788873800.431918:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788873800.431925:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3636:x1875769859086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.431966:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3636:x1875769859086592:12345-0@lo:400:kworker.0 Request processed in 41us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.431972:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788873800.432007:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087616 00000100:00100000:2.0:1788873800.432011:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087616 00000100:00100000:2.0:1788873800.432029:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088128 00000100:00100000:2.0:1788873800.432032:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088128 00000100:00100000:2.0:1788873800.432054:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087488 00000100:00100000:2.0:1788873800.432057:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087488 00000100:00100000:2.0:1788873800.432067:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088000 00000100:00100000:2.0:1788873800.432070:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088000 00000100:00100000:2.0:1788873800.432084:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788873800.432089:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859087616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432120:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859087616:12345-0@lo:400:kworker.0 Request processed in 30us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432126:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788873800.432139:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788873800.432145:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859088128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432172:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859088128:12345-0@lo:400:kworker.0 Request processed in 28us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432177:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788873800.432188:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788873800.432201:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859087488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432258:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859087488:12345-0@lo:400:kworker.0 Request processed in 58us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432264:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788873800.432275:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788873800.432282:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859088000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432305:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859088000:12345-0@lo:400:kworker.0 Request processed in 25us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432311:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788873800.432417:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788873800.432441:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d34412ad500 x1875769859087488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873800.432454:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859087488:0@lo:400:kworker.0 00010000:00080000:2.0:1788873800.432464:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d34412af100 x1875769859088000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873800.432472:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859088000:0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432481:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859086592:0@lo:400:kworker.0 00010000:00080000:2.0:1788873800.432492:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d34412ace00 x1875769859087616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873800.432500:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859087616:0@lo:400:kworker.0 00010000:00080000:2.0:1788873800.432509:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d34412ad880 x1875769859088128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873800.432516:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859088128:0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432562:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087104 00000100:00100000:2.0:1788873800.432566:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087104 00000100:00100000:2.0:1788873800.432595:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788873800.432601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859087104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432640:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859087104:12345-0@lo:400:kworker.0 Request processed in 40us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788873800.432675:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432702:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086720 00000100:00100000:2.0:1788873800.432706:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086720 00000100:00100000:2.0:1788873800.432727:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087232 00000100:00100000:2.0:1788873800.432730:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087232 00000100:00100000:2.0:1788873800.432750:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087744 00000100:00100000:2.0:1788873800.432753:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087744 00000100:00100000:2.0:1788873800.432780:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788873800.432786:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432817:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859086720:12345-0@lo:400:kworker.0 Request processed in 32us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432823:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788873800.432835:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788873800.432841:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859087232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432865:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859087232:12345-0@lo:400:kworker.0 Request processed in 25us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432871:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788873800.432882:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788873800.432888:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859087744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.432924:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859087744:12345-0@lo:400:kworker.0 Request processed in 36us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.432929:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1788873800.432946:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873800.433101:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859087744:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433125:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859086720:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433136:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859087232:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433146:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788873800.433154:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859086848:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.433199:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859087360:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433237:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.433254:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859087872:0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433273:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.433295:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087360 00000100:00100000:1.0:1788873800.433299:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087360 00000100:00100000:3.0:1788873800.433639:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859087872 00000100:00100000:3.0:1788873800.433644:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859087872 00000100:00100000:2.0:1788873800.433711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859086848 00000100:00100000:2.0:1788873800.433715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859086848 00000100:00100000:2.0:1788873800.433744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788873800.433751:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873800.433808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859086848:12345-0@lo:400:kworker.0 Request processed in 58us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.433814:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788873800.433848:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873800.433908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788873800.433916:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859087360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873800.433947:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859087360:12345-0@lo:400:kworker.0 Request processed in 33us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873800.433953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788873800.434477:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859086848:0@lo:400:kworker.0 00010000:00080000:0.0:1788873800.434493:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f44f800 x1875769859087360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873800.434502:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859087360:0@lo:400:kworker.0 00000100:00100000:3.0:1788873800.440297:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788873800.440328:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859087872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873800.440428:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859087872:12345-0@lo:400:kworker.0 Request processed in 120us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873800.440436:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:0.0:1788873800.440554:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d34412af480 x1875769859087872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873800.440570:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859087872:0@lo:400:kworker.0 10000000:01000000:0.0:1788873800.624098:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788873800.624112:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3341ecd800 from 7 10000000:01000000:0.0:1788873800.624119:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873800.624201:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.624250:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.624296:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873800.624330:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.624430:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.624502:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b25240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873800.624826:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088256 00000100:00100000:1.0:1788873800.624836:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088256 00000100:00100000:1.0:1788873800.624916:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788873800.624927:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859088256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873800.624943:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873800.624961:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b718 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.624989:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.625010:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.625020:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca200, rc 0) 00000100:00100000:1.0:1788873800.625084:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859088256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873800.625091:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788873800.627070:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873800.627104:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.627120:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873800.627253:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.627437:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.627538:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b25240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873800.628599:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088384 00000100:00100000:3.0:1788873800.628613:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088384 00000100:00100000:3.0:1788873800.628683:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788873800.628694:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859088384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873800.629384:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859088384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 688us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873800.629396:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788873800.631371:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.631454:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.631557:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.631604:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b25240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873800.632331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088512 00000100:00100000:3.0:1788873800.632344:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088512 00000100:00100000:3.0:1788873800.632633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788873800.632646:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859088512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873800.634417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859088512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1763us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873800.634445:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788873800.641925:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788873800.650577:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788873800.659743:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788873800.659856:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873800.659873:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.659930:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873800.659945:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788873800.659948:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3476df3800 from 7 10000000:01000000:0.0:1788873800.659951:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873800.660002:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.660010:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.660024:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873800.660068:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.660159:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.660510:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873800.666261:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088640 00000100:00100000:3.0:1788873800.666285:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088640 00000100:00100000:3.0:1788873800.666378:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788873800.666391:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859088640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873800.666413:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873800.666440:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b726 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873800.666477:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873800.666491:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873800.666502:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443a00, rc 0) 00000100:00100000:3.0:1788873800.666611:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859088640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (6451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873800.666619:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788873800.668103:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873800.668137:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.668152:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873800.668292:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.668362:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.668419:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873800.668571:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088768 00000100:00100000:3.0:1788873800.668579:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088768 00000100:00100000:3.0:1788873800.668631:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788873800.668643:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859088768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873800.668802:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859088768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873800.668811:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788873800.669177:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.669245:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.669296:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.669326:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873800.673462:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859088896 00000100:00100000:2.0:1788873800.673483:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859088896 00000100:00100000:2.0:1788873800.673563:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788873800.673576:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859088896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873800.673822:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859088896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.673830:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788873800.674033:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859088896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788873800.674968:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788873800.675055:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788873800.675128:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873800.675141:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.675154:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873800.675167:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788873800.675171:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34651cb800 from 7 10000000:01000000:1.0:1788873800.675174:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873800.675248:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.675257:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.675286:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873800.675314:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.675381:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.675420:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488840 going to sleep for 11 seconds 00000100:00100000:0.0:1788873800.675664:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089024 00000100:00100000:0.0:1788873800.675674:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089024 00000100:00100000:0.0:1788873800.675737:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788873800.675748:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859089024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873800.675774:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873800.675792:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b734 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.675826:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.675838:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.675847:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92000, rc 0) 00000100:00100000:0.0:1788873800.675905:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859089024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873800.675913:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788873800.679171:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873800.680006:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.680026:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873800.680155:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.680330:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.682069:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488840 going to sleep for 11 seconds 00000100:00100000:0.0:1788873800.683478:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089152 00000100:00100000:0.0:1788873800.683498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089152 00000100:00100000:0.0:1788873800.683728:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788873800.683742:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859089152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.684010:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859089152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873800.684035:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788873800.684143:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873800.684228:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873800.684290:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.690491:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089280 00000100:00100000:1.0:1788873800.690516:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089280 00000100:00100000:1.0:1788873800.690589:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788873800.690602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859089280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.690820:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859089280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (6530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873800.690828:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788873800.690957:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343867300 going to sleep for 11 seconds 00000100:00100000:2.0:1788873800.690987:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788873800.692056:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788873800.692478:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788873800.692514:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873800.692530:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.692553:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873800.692567:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788873800.692570:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34473c7800 from 7 10000000:01000000:1.0:1788873800.692574:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873800.692622:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.692632:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.692646:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873800.692677:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.692753:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.692847:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873800.692925:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089408 00000100:00100000:3.0:1788873800.692942:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089408 00000100:00100000:0.0:1788873800.693085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788873800.693100:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859089408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873800.693117:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873800.693134:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b742 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.693166:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.693178:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.693188:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92800, rc 0) 00000100:00100000:0.0:1788873800.693417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859089408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873800.693425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788873800.693608:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873800.693628:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873800.693638:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873800.693716:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.693747:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.693829:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873800.693861:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089536 00000100:00100000:0.0:1788873800.693867:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089536 00000100:00100000:0.0:1788873800.694016:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788873800.694025:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859089536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873800.694176:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859089536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873800.694184:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788873800.694312:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.694348:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873800.694395:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.694571:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873800.694628:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089664 00000100:00100000:3.0:1788873800.694633:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089664 00000100:00100000:3.0:1788873800.694657:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788873800.694665:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859089664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873800.698180:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859089664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3499us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873800.698200:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788873800.700277:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859089664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788873800.702521:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788873800.703284:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788873800.703316:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873800.703331:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873800.703361:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873800.814568:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873800.948413:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873800.948436:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859089792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873800.948509:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873800.948596:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089792 00000100:00100000:2.0:1788873800.948605:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089792 00000100:00100000:2.0:1788873800.948656:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788873800.948667:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859089792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873800.948965:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873800.949023:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859089792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 357us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873800.949029:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788873800.949126:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b2f800 x1875769859089792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873800.949146:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859089792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873800.952352:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873800.952375:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859089920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873800.952448:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873800.952509:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859089920 00000100:00100000:1.0:1788873800.952516:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859089920 00000100:00100000:1.0:1788873800.952559:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788873800.952568:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859089920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873800.952615:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873800.952661:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859089920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873800.952667:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788873800.952863:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859089920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873800.953027:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873800.953037:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859090048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873800.953069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873800.953463:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090048 00000100:00100000:0.0:1788873800.953469:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090048 00000100:00100000:0.0:1788873800.953510:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788873800.953518:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859090048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873800.953534:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873800.953589:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859090048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873800.953596:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788873800.953628:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a35500 x1875769859090048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873800.953645:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859090048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873801.224590:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.224744:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126592 00000100:00100000:3.0:1788873801.224767:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126592 00000100:00100000:3.0:1788873801.224888:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 328 00000100:00100000:3.0:1788873801.224900:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:6175:x1875769840126592:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873801.224918:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873801.224937:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9580 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873801.224968:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873801.224981:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873801.224990:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873801.225061:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840126592:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 163us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.225076:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 328 00000100:00100000:2.0:1788873801.235311:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.240293:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126720 00000100:00100000:3.0:1788873801.240307:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126720 00000100:00100000:3.0:1788873801.243133:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 329 00000100:00100000:3.0:1788873801.243168:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840126720:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873801.243365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840126720:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 215us (8064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.243373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 329 00000100:00100000:1.0:1788873801.248777:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873801.248824:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126848 00000100:00100000:1.0:1788873801.248834:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126848 00000100:00100000:1.0:1788873801.248896:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 330 00000100:00100000:1.0:1788873801.248906:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840126848:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873801.249036:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840126848:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873801.249044:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 330 00000100:00100000:2.0:1788873801.262632:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.263299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840126976 00000100:00100000:3.0:1788873801.263310:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840126976 00000100:00100000:3.0:1788873801.263371:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 331 00000100:00100000:3.0:1788873801.263381:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840126976:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873801.263398:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873801.263418:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9587 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873801.263624:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873801.263637:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873801.263646:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873801.263729:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840126976:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 349us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.263737:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 331 00000100:00100000:1.0:1788873801.268783:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873801.269617:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127104 00000100:00100000:2.0:1788873801.269630:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127104 00000100:00100000:2.0:1788873801.269699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 332 00000100:00100000:2.0:1788873801.269709:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840127104:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873801.269908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840127104:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 199us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873801.269916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 332 00000100:00100000:3.0:1788873801.278738:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873801.278882:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127232 00000100:00100000:0.0:1788873801.278893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127232 00000100:00100000:0.0:1788873801.278951:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 333 00000100:00100000:0.0:1788873801.278960:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840127232:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873801.279120:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840127232:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 159us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873801.279128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 333 00000100:00100000:3.0:1788873801.352733:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.352789:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127488 00000100:00100000:3.0:1788873801.352799:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127488 00000100:00100000:3.0:1788873801.352877:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 203 00000100:00100000:3.0:1788873801.352887:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840127488:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873801.352959:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840127488:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.352966:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 203 00000100:00080000:3.0:1788873801.352986:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873801.353791:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.353826:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.353846:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873801.353866:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127360 00000100:00100000:3.0:1788873801.353870:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127360 00000100:00100000:3.0:1788873801.353898:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127616 00000100:00100000:3.0:1788873801.353900:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127616 00000100:00100000:3.0:1788873801.353913:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127744 00000100:00100000:3.0:1788873801.353915:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127744 00000100:00100000:3.0:1788873801.353928:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 204 00000100:00100000:3.0:1788873801.353934:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840127360:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873801.353970:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840127360:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.353976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 204 00000100:00100000:3.0:1788873801.353988:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 205 00000100:00100000:3.0:1788873801.353993:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840127616:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873801.354012:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840127616:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 19us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.354017:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 205 00000100:00100000:3.0:1788873801.354027:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 206 00000100:00100000:3.0:1788873801.354042:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840127744:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873801.354069:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840127744:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873801.354075:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 206 00000100:00080000:3.0:1788873801.354094:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873801.354096:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788873801.838700:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873802.862587:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873803.502397:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859090176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873803.502473:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873803.502559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090176 00000100:00100000:1.0:1788873803.502567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090176 00000100:00100000:1.0:1788873803.502615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788873803.502624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859090176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873803.502664:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788873803.502724:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859090176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873803.502731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788873803.503428:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859090176:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788873803.601952:0:13381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788873803.887789:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873804.913369:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873805.041537:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859090304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873805.041613:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873805.042025:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090304 00000100:00100000:1.0:1788873805.042034:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090304 00000100:00100000:1.0:1788873805.042106:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788873805.042131:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859090304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873805.042166:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873805.042257:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859090304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873805.042264:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1788873805.044252:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1e300 x1875769859090304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873805.044314:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859090304:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788873805.044853:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873805.044862:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873805.044874:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859090432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873805.044945:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873805.045022:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090432 00000100:00100000:3.0:1788873805.045029:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090432 00000100:00100000:3.0:1788873805.045083:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788873805.045093:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859090432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873805.045115:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873805.045159:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859090432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873805.045166:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788873805.045183:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873805.045226:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d34412ad180 x1875769859090432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873805.045240:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859090432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873805.551189:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873805.551269:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873805.551300:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859090688:0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.551398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873805.552441:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859090560:0@lo:400:kworker.0 00000100:00100000:1.0:1788873805.552496:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.552621:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090688 00000100:00100000:2.0:1788873805.552629:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090688 00000100:00100000:2.0:1788873805.552679:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788873805.552688:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.552751:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859090688:12345-0@lo:400:kworker.0 Request processed in 64us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.552758:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788873805.552769:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859090944:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.552798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873805.553699:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859091456:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.553751:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873805.553777:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859091968:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.553798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873805.553821:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788873805.553828:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859090816:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.553852:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873805.553870:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859091328:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.553893:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873805.554044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090816 00000100:00100000:1.0:1788873805.554051:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090816 00000100:00100000:1.0:1788873805.554093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788873805.554103:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859090816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873805.554151:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859090816:12345-0@lo:400:kworker.0 Request processed in 50us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873805.554157:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788873805.554186:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859091200:0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.555898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090560 00000100:00100000:3.0:1788873805.555915:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090560 00000100:00100000:3.0:1788873805.555969:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788873805.555979:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859090560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.556054:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859090560:12345-0@lo:400:kworker.0 Request processed in 77us (3557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873805.556061:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788873805.557652:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859091840:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.557726:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.557848:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859090944 00000100:00100000:2.0:1788873805.557857:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859090944 00000100:00100000:3.0:1788873805.557893:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091328 00000100:00100000:3.0:1788873805.557898:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091328 00000100:00100000:2.0:1788873805.557913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788873805.557922:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859090944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.557934:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788873805.557941:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859091328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873805.558003:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091840 00000100:00100000:1.0:1788873805.558007:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091840 00000100:00100000:1.0:1788873805.558030:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788873805.558037:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859091840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.560951:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859090944:12345-0@lo:400:kworker.0 Request processed in 3017us (8139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.560968:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788873805.561589:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.561640:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859091712:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.561698:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.563674:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859090560:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.563711:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788873805.563731:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859091072:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.563804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.563847:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859091584:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.563873:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.563892:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859092096:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.563930:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873805.563972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091072 00000100:00100000:2.0:1788873805.563979:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091072 00000100:00100000:2.0:1788873805.564025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788873805.564033:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859091072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.564093:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859091072:12345-0@lo:400:kworker.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.564101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788873805.564135:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091456 00000100:00100000:2.0:1788873805.564139:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091456 00000100:00100000:2.0:1788873805.564160:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091968 00000100:00100000:2.0:1788873805.564164:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091968 00000100:00100000:2.0:1788873805.564178:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091584 00000100:00100000:2.0:1788873805.564181:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091584 00000100:00100000:2.0:1788873805.564191:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092096 00000100:00100000:2.0:1788873805.564193:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092096 00000100:00100000:3.0:1788873805.564820:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859091328:12345-0@lo:400:kworker.0 Request processed in 6875us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873805.564831:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788873805.564852:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091200 00000100:00100000:3.0:1788873805.564856:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091200 00000100:00100000:3.0:1788873805.564878:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859091712 00000100:00100000:3.0:1788873805.564881:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859091712 00000100:00100000:3.0:1788873805.564897:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788873805.564903:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859091200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.564943:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859091200:12345-0@lo:400:kworker.0 Request processed in 40us (3357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873805.564949:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788873805.564959:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788873805.564964:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859091712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.564986:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859091712:12345-0@lo:400:kworker.0 Request processed in 22us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873805.565000:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1788873805.565018:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873805.565021:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873805.565023:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873805.565830:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788873805.565847:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859091456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.565906:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859091456:12345-0@lo:400:kworker.0 Request processed in 67us (12155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.565914:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788873805.565938:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788873805.565944:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859091968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873805.565945:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859090688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.565971:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859091968:12345-0@lo:400:kworker.0 Request processed in 28us (12172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.565977:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788873805.565988:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788873805.565995:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859091584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.566037:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859091584:12345-0@lo:400:kworker.0 Request processed in 42us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.566043:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788873805.566057:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788873805.566064:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859092096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.566092:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859092096:12345-0@lo:400:kworker.0 Request processed in 29us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873805.566098:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788873805.566136:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859091072:0@lo:400:kworker.0 00010000:00080000:2.0:1788873805.566153:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0a300 x1875769859091584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873805.566163:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859091584:0@lo:400:kworker.0 00010000:00080000:2.0:1788873805.566173:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435d2300 x1875769859092096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873805.566180:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859092096:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.566194:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859091200:0@lo:400:kworker.0 00000100:00100000:2.0:1788873805.566583:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859091712:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.567126:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859090944:0@lo:400:kworker.0 00010000:00080000:0.0:1788873805.567142:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0b800 x1875769859091456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873805.567765:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859091456:0@lo:400:kworker.0 00010000:00080000:0.0:1788873805.567784:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a09c00 x1875769859091968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873805.567793:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859091968:0@lo:400:kworker.0 00000100:00100000:0.0:1788873805.567819:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859090816:0@lo:400:kworker.0 00010000:00080000:0.0:1788873805.567849:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1e300 x1875769859091328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873805.567858:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859091328:0@lo:400:kworker.0 00000100:00100000:1.0:1788873805.568410:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859091840:12345-0@lo:400:kworker.0 Request processed in 10370us (10691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873805.568421:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:0.0:1788873805.568496:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a09180 x1875769859091840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873805.568506:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859091840:0@lo:400:kworker.0 00010000:00010000:2.0:1788873805.934577:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873806.062679:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873806.062739:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859092224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873806.062823:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873806.063051:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859092480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873806.063569:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859092352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873806.063600:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873806.063635:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092352 00000100:00100000:3.0:1788873806.063643:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092352 00000100:00100000:3.0:1788873806.063692:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873806.063702:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859092352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873806.063752:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873806.063798:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859092352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873806.063805:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873806.063853:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859092352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873806.063998:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873806.064914:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092224 00000100:00100000:0.0:1788873806.064923:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092224 00000100:00100000:0.0:1788873806.064966:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092480 00000100:00100000:0.0:1788873806.064970:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092480 00000100:00100000:0.0:1788873806.064985:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788873806.064992:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859092224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873806.065019:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873806.065141:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788873806.065150:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859092480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873806.065163:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873806.065221:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859092480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873806.065228:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1788873806.065289:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343806300 x1875769859092480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873806.065306:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859092480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873806.065516:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859092224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 524us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873806.065522:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788873806.065699:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435d3100 x1875769859092224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873806.065726:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859092224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873806.482633:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873806.483155:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873806.483355:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873806.483432:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840127872 00000100:00100000:1.0:1788873806.483444:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840127872 00000100:00100000:1.0:1788873806.483563:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 335 00000100:00100000:1.0:1788873806.483577:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840127872:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873806.483665:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840127872:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 91us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873806.483673:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 335 00000100:00100000:3.0:1788873806.484864:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873806.485014:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128128 00000100:00100000:0.0:1788873806.485021:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128128 00000100:00100000:0.0:1788873806.485119:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128384 00000100:00100000:0.0:1788873806.485123:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128384 00000100:00100000:3.0:1788873806.485173:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873806.485194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128000 00000100:00100000:3.0:1788873806.485226:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128000 00000100:00100000:2.0:1788873806.485265:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128256 00000100:00100000:2.0:1788873806.485276:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128256 00000100:00080000:1.0:1788873806.485311:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873806.485315:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873806.485330:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 213 00000100:00100000:1.0:1788873806.485340:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840128128:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873806.485405:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840128128:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 66us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873806.485413:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 213 00000100:00100000:0.0:1788873806.485697:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 214 00000100:00100000:0.0:1788873806.485715:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840128384:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873806.485752:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840128384:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 48us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873806.485760:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 214 00000100:00100000:3.0:1788873806.485983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 215 00000100:00100000:3.0:1788873806.485991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840128000:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873806.486026:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840128000:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 36us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873806.486033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 215 00000100:00100000:2.0:1788873806.487732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 216 00000100:00100000:2.0:1788873806.487747:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840128256:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873806.487904:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840128256:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 161us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873806.487913:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 216 00010000:00010000:2.0:1788873806.959183:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873807.997257:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873808.624694:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873808.624727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859092608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873808.624822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873808.624950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092608 00000100:00100000:0.0:1788873808.624960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092608 00000100:00100000:0.0:1788873808.625029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788873808.625041:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859092608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873808.625093:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873808.625168:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859092608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873808.625177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788873808.625356:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859092608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873809.006487:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788873809.208492:0:13529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:23:28 (1788873808) === 00000100:00100000:0.0:1788873809.463903:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.463956:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.464318:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128512 00000100:00100000:1.0:1788873809.464329:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128512 00000100:00100000:3.0:1788873809.464438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128640 00000100:00100000:3.0:1788873809.464442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128640 00000100:00100000:3.0:1788873809.464498:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:3.0:1788873809.464509:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10501:x1875769840128640:12345-192.168.202.20@tcp:700:mkdir.0 00000100:00100000:3.0:1788873809.464592:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10501:x1875769840128640:12345-192.168.202.20@tcp:700:mkdir.0 Request processed in 83us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873809.464600:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:1.0:1788873809.466520:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:1.0:1788873809.466535:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840128512:12345-192.168.202.20@tcp:41:mkdir.0 00000004:00000024:1.0:1788873809.466571:0:8450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788873809.466653:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840128512:12345-192.168.202.20@tcp:41:mkdir.0 Request processed in 121us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873809.466690:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00080000:2.0:1788873809.470797:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873809.481917:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.482166:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840128896 00000100:00100000:0.0:1788873809.482184:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840128896 00000100:00100000:0.0:1788873809.482261:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:0.0:1788873809.482272:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:10501:x1875769840128896:12345-192.168.202.20@tcp:36:mkdir.0 00010000:00010000:0.0:1788873809.482326:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873809.482377:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d344cfeb000/0x25c660afb0a9b600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94fb expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.482399:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd500) 00010000:00010000:0.0:1788873809.482421:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873809.482497:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.482509:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.482518:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.482556:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.482564:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.482571:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483613:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483627:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483635:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873809.483650:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa45a043 reply state 00000000364bc0e0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483661:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483668:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d33410e1800) 00010000:00010000:0.0:1788873809.483672:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873809.483675:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788873809.483693:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788873809.483700:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483707:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483720:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483734:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873809.483738:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483746:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483755:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410e1700) 00010000:00010000:0.0:1788873809.483757:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873809.483760:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483767:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b75e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873809.483783:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa45a043 reply state 00000000364bc0e0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483790:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.483795:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d33410e1b00) 00010000:00010000:0.0:1788873809.483797:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873809.483799:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788873809.483880:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10501:x1875769840128896:12345-192.168.202.20@tcp:36:mkdir.0 Request processed in 1606us (1969us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788873809.483888:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:3.0:1788873809.491817:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.491975:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840129024 00000100:00100000:2.0:1788873809.491989:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840129024 00000100:00100000:2.0:1788873809.492170:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:2.0:1788873809.492192:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10502:x1875769840129024:12345-192.168.202.20@tcp:101:chmod.0 00010000:00010000:2.0:1788873809.492284:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873809.492314:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a958e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.492389:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b77a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.492406:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.492422:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873809.492481:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788873809.492485:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873809.492522:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.492565:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a958e expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.492588:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b77a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a958e expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.492598:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3460230600) 00010000:00010000:2.0:1788873809.492601:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788873809.492605:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ec00, rc 0) 00000100:00100000:2.0:1788873809.492673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:10502:x1875769840129024:12345-192.168.202.20@tcp:101:chmod.0 Request processed in 483us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873809.492694:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:0.0:1788873809.503944:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.504421:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840129280 00000100:00100000:1.0:1788873809.504432:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840129280 00000100:00100000:1.0:1788873809.504500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:1.0:1788873809.504511:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:10502:x1875769840129280:12345-192.168.202.20@tcp:36:chmod.0 00010000:00010000:1.0:1788873809.504572:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873809.504601:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b77a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a958e expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.504620:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3460230600) 00010000:00010000:1.0:1788873809.504630:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873809.504656:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.504670:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.504692:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873809.505559:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6452de8 reply state 000000003fde0649 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.505577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.505585:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:1.0:1788873809.505588:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788873809.505598:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788873809.505608:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788873809.506462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:10502:x1875769840129280:12345-192.168.202.20@tcp:36:chmod.0 Request processed in 1947us (2521us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788873809.506472:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:0.0:1788873809.557078:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.557234:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840129408 00000100:00100000:1.0:1788873809.557245:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840129408 00000100:00100000:1.0:1788873809.557333:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:1.0:1788873809.557343:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+9:10503:x1875769840129408:12345-192.168.202.20@tcp:101:chown.0 00010000:00010000:1.0:1788873809.557367:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873809.557388:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9595 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.557451:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca000/0x25c660afb0a9b78f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.557629:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca000/0x25c660afb0a9b78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.557642:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca000/0x25c660afb0a9b78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873809.557699:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788873809.557703:0:8993:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873809.557753:0:8993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca000/0x25c660afb0a9b78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.557781:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9595 expref: 11 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.557800:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca000/0x25c660afb0a9b78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9595 expref: 10 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.557824:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:1.0:1788873809.557827:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873809.557831:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca000, rc 0) 00000100:00100000:1.0:1788873809.557905:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+10:10503:x1875769840129408:12345-192.168.202.20@tcp:101:chown.0 Request processed in 562us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873809.557912:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:3.0:1788873809.566714:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.566828:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840129536 00000100:00100000:2.0:1788873809.566840:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840129536 00000100:00100000:2.0:1788873809.566902:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:2.0:1788873809.566911:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+10:10503:x1875769840129536:12345-192.168.202.20@tcp:101:chown.0 00010000:00010000:2.0:1788873809.566933:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873809.566958:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a959c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567031:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567047:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567059:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567083:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567089:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567093:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567180:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b7ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567189:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567195:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873809.567272:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788873809.567275:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873809.567293:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567302:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567306:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567311:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567322:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.567326:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567331:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567340:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:2.0:1788873809.567342:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.567345:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567349:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b79d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567454:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567459:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567463:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567465:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.567467:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567470:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567484:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d33410e1b00) 00010000:00010000:2.0:1788873809.567487:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.567490:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567496:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567526:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a959c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567539:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b7ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a959c expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.567546:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d33410e1800) 00010000:00010000:2.0:1788873809.567548:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788873809.567550:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e800, rc 0) 00000100:00100000:2.0:1788873809.567610:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+11:10503:x1875769840129536:12345-192.168.202.20@tcp:101:chown.0 Request processed in 700us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873809.567617:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:2.0:1788873809.571062:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873809.571122:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840129664 00000100:00100000:3.0:1788873809.571133:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840129664 00000100:00100000:3.0:1788873809.571201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:3.0:1788873809.571230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:10503:x1875769840129664:12345-192.168.202.20@tcp:900:chown.0 00000100:00100000:3.0:1788873809.571309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:10503:x1875769840129664:12345-192.168.202.20@tcp:900:chown.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873809.571328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:1.0:1788873809.575064:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873809.575454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840129920 00000100:00100000:3.0:1788873809.575464:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840129920 00000100:00100000:3.0:1788873809.575522:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 28 00000100:00100000:3.0:1788873809.575533:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+11:10503:x1875769840129920:12345-192.168.202.20@tcp:36:chown.0 00010000:00010000:3.0:1788873809.575590:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873809.575621:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b7ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a959c expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873809.575642:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d33410e1800) 00010000:00010000:3.0:1788873809.575647:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873809.575669:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873809.575696:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873809.575707:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788873809.580033:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1788873809.580340:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580353:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580370:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580389:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.580393:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580402:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580419:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d33410e1b00) 00010000:00010000:2.0:1788873809.580422:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.580426:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580432:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b765 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580453:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580458:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580463:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580467:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.580469:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580474:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580501:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d33410e1800) 00010000:00010000:2.0:1788873809.580503:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.580507:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580512:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b76c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580525:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580531:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580536:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580540:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.580542:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580548:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580554:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:2.0:1788873809.580556:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788873809.580559:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.580565:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9b781 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873809.580913:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003518dd4c reply state 0000000013cf90c2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873809.580925:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873809.580931:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d33410e1800) 00010000:00010000:3.0:1788873809.580932:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788873809.580935:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788873809.580949:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788873809.581026:0:6512:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788873809.581049:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10503:x1875769840129920:12345-192.168.202.20@tcp:36:chown.0 Request processed in 5513us (5988us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788873809.581059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 28 00010000:00010000:1.0:1788873809.581328:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.581343:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.581349:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.581359:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873809.581362:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.581369:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.581378:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d33410e1800) 00010000:00010000:1.0:1788873809.581381:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788873809.581384:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.581400:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b7b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873809.598710:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.598928:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840130048 00000100:00100000:1.0:1788873809.598938:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840130048 00000100:00100000:1.0:1788873809.599050:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:1.0:1788873809.599062:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:10504:x1875769840130048:12345-192.168.202.20@tcp:101:touch.500 00010000:00010000:1.0:1788873809.599087:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873809.599111:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9b7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95a3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788873809.602102:0:8450:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2932us 00010000:00010000:2.0:1788873809.618958:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.618981:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.618993:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619004:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619009:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619013:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619128:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b7ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619136:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619143:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873809.619188:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788873809.619192:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873809.619255:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619274:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619279:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619286:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619292:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.619296:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619304:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619316:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:2.0:1788873809.619319:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.619323:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619328:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b7c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619338:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619343:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619348:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619371:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.619374:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619379:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619386:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3460230800) 00010000:00010000:2.0:1788873809.619389:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.619392:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619397:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619431:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9b7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95a3 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619442:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b7ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95a3 expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.619447:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:2.0:1788873809.619448:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788873809.619450:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873809.619520:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10504:x1875769840130048:12345-192.168.202.20@tcp:101:touch.500 Request processed in 20459us (20849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873809.619529:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:2.0:1788873809.626416:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.626586:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840130304 00000100:00100000:0.0:1788873809.626596:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840130304 00000100:00100000:0.0:1788873809.626651:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:0.0:1788873809.626662:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10504:x1875769840130304:12345-192.168.202.20@tcp:101:touch.500 00010000:00010000:0.0:1788873809.626690:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873809.626713:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93c00/0x25c660afb0a9b7d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95aa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.626823:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.626848:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.626860:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.626922:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.626930:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.626937:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788873809.627345:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788873809.627487:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b7ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627511:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627519:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627554:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627561:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627569:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627575:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873809.627579:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627586:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627597:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:0.0:1788873809.627600:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873809.627604:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627611:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b7dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873809.627624:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db8db484 reply state 00000000cf8372a9 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627640:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627646:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d33410dce00) 00010000:00010000:0.0:1788873809.627649:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873809.627651:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788873809.627692:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93c00/0x25c660afb0a9b7d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95aa expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627707:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b7ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95aa expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.627714:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dc900) 00010000:00010000:0.0:1788873809.627716:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873809.627718:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92e00, rc 0) 00000100:00100000:0.0:1788873809.627771:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:10504:x1875769840130304:12345-192.168.202.20@tcp:101:touch.500 Request processed in 1110us (1363us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788873809.627777:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:3.0:1788873809.633661:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.634008:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840130560 00000100:00100000:0.0:1788873809.634023:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840130560 00000100:00100000:0.0:1788873809.634087:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:0.0:1788873809.634098:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+10:10504:x1875769840130560:12345-192.168.202.20@tcp:36:touch.500 00010000:00010000:0.0:1788873809.634160:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873809.634198:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92e00/0x25c660afb0a9b7ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95aa expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.634238:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dc900) 00010000:00010000:0.0:1788873809.634265:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873809.634326:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.634342:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.634368:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873809.634493:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086534681 reply state 00000000dcc4a4ba transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.634506:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.634513:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:0.0:1788873809.634515:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873809.634518:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873809.634603:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+11:10504:x1875769840130560:12345-192.168.202.20@tcp:36:touch.500 Request processed in 507us (954us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788873809.634611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:3.0:1788873809.638168:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.638400:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840130688 00000100:00100000:2.0:1788873809.638411:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840130688 00000100:00100000:2.0:1788873809.638483:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 32 00000100:00100000:2.0:1788873809.638494:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+11:10504:x1875769840130688:12345-192.168.202.20@tcp:101:touch.500 00010000:00010000:2.0:1788873809.638523:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873809.638548:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95b1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.638614:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95b1 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.638631:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95b1 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.638652:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:2.0:1788873809.638655:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788873809.638659:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ec00, rc 0) 00000100:00100000:2.0:1788873809.638724:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+12:10504:x1875769840130688:12345-192.168.202.20@tcp:101:touch.500 Request processed in 232us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873809.638731:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 32 00000100:00100000:2.0:1788873809.643252:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.643384:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840130816 00000100:00100000:0.0:1788873809.643394:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840130816 00000100:00100000:0.0:1788873809.643441:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:0.0:1788873809.643450:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875769840130816:12345-192.168.202.20@tcp:8:touch.500 00010000:00080000:0.0:1788873809.643488:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1788873809.643519:0:8424:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9b806 00002000:00100000:0.0:1788873809.643531:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64e5d878-4280-4742-8a19-a12ccf17cae7/ffff9d334400f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788873809.643565:0:8424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788873809.643639:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788873809.643668:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9d334400a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873809.643738:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840130816:12345-192.168.202.20@tcp:8:touch.500 Request processed in 287us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873809.643746:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:3.0:1788873809.650584:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.650766:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840130944 00000100:00100000:2.0:1788873809.650776:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840130944 00000100:00100000:2.0:1788873809.650874:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:2.0:1788873809.650886:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840130944:12345-192.168.202.20@tcp:2:touch.500 00000100:00080000:1.0:1788873809.651195:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788873809.661398:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788873809.661417:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000100:00100000:2.0:1788873809.661764:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:0:x1875769840130944:12345-192.168.202.20@tcp:2:touch.500 Request processed in 10875us (11188us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788873809.661789:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:3.0:1788873809.666334:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.666738:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840131200 00000100:00100000:0.0:1788873809.666749:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840131200 00000100:00100000:0.0:1788873809.666810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:0.0:1788873809.666820:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+12:10504:x1875769840131200:12345-192.168.202.20@tcp:35:touch.500 00000100:00100000:0.0:1788873809.667123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+13:10504:x1875769840131200:12345-192.168.202.20@tcp:35:touch.500 Request processed in 303us (798us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788873809.667131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:0.0:1788873809.684458:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.684553:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840131328 00000100:00100000:1.0:1788873809.684564:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840131328 00000100:00100000:1.0:1788873809.684632:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:1.0:1788873809.684642:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+13:10505:x1875769840131328:12345-192.168.202.20@tcp:101:rm.0 00010000:00010000:1.0:1788873809.684667:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873809.684702:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95b8 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.684781:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9b814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.684810:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9b814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.684824:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9b814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873809.684899:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788873809.684903:0:8993:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873809.684939:0:8993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9b814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.684966:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95b8 expref: 15 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.684986:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9b814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95b8 expref: 14 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.684995:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:1.0:1788873809.684997:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873809.685001:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb000, rc 0) 00000100:00100000:1.0:1788873809.685067:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+14:10505:x1875769840131328:12345-192.168.202.20@tcp:101:rm.0 Request processed in 426us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873809.685073:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:3.0:1788873809.691389:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.691586:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840131584 00000100:00100000:2.0:1788873809.691597:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840131584 00000100:00100000:2.0:1788873809.691668:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:2.0:1788873809.691694:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+14:10505:x1875769840131584:12345-192.168.202.20@tcp:101:rm.0 00010000:00010000:2.0:1788873809.691715:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873809.691736:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95bf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873809.692089:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788873809.692303:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b81b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95bf expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.692319:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:2.0:1788873809.692322:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873809.692328:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95bf expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.692342:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ee00, rc 0) 00000100:00100000:2.0:1788873809.692396:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+15:10505:x1875769840131584:12345-192.168.202.20@tcp:101:rm.0 Request processed in 720us (1017us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788873809.692403:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:3.0:1788873809.702015:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.702285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840131712 00000100:00100000:0.0:1788873809.702294:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840131712 00000100:00100000:0.0:1788873809.702348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:0.0:1788873809.702368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+15:10505:x1875769840131712:12345-192.168.202.20@tcp:37:rm.0 00000100:00100000:1.0:1788873809.708113:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+15:10505:x1875769840131712:12345-192.168.202.20@tcp:37:rm.0 Request processed in 5746us (6099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873809.708134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:3.0:1788873809.716720:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.716836:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840131968 00000100:00100000:2.0:1788873809.716846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840131968 00000100:00100000:2.0:1788873809.716913:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:2.0:1788873809.716923:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+15:10505:x1875769840131968:12345-192.168.202.20@tcp:35:rm.0 00000100:00100000:2.0:1788873809.717155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+16:10505:x1875769840131968:12345-192.168.202.20@tcp:35:rm.0 Request processed in 233us (556us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788873809.717163:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:3.0:1788873809.725099:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.725578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840132224 00000100:00100000:0.0:1788873809.725587:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840132224 00000100:00100000:0.0:1788873809.725645:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788873809.725655:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+16:10505:x1875769840132224:12345-192.168.202.20@tcp:101:rm.0 00010000:00010000:0.0:1788873809.725689:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873809.725726:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9b829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.725847:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b830 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.725861:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.725873:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873809.725884:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788873809.726011:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9b829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95c6 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.726025:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b830 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95c6 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873809.726031:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:0.0:1788873809.726034:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788873809.726036:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92400, rc 0) 00000100:00100000:0.0:1788873809.726088:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840132224:12345-192.168.202.20@tcp:101:rm.0 Request processed in 433us (1000us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788873809.726094:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788873809.734182:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873809.734448:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840132352 00000100:00100000:3.0:1788873809.734459:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840132352 00000100:00100000:3.0:1788873809.734518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:3.0:1788873809.734530:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840132352:12345-192.168.202.20@tcp:41:rm.0 00000004:00000024:3.0:1788873809.734589:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788873809.734687:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840132352:12345-192.168.202.20@tcp:41:rm.0 Request processed in 150us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873809.734695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:3.0:1788873809.737841:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873809.737974:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840132480 00000100:00100000:2.0:1788873809.737985:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840132480 00000100:00100000:2.0:1788873809.738046:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:2.0:1788873809.738056:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840132480:12345-192.168.202.20@tcp:101:rm.0 00010000:00010000:2.0:1788873809.738075:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873809.738098:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b83e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95cd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738165:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738289:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738304:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738318:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738324:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738330:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738582:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738975:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.738983:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873809.739019:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788873809.739023:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873809.739041:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739052:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739059:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739066:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739072:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739077:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.739082:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739089:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739100:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:2.0:1788873809.739103:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.739115:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739121:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9b845 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739135:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739143:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739148:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739153:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873809.739156:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739161:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739442:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d33410dce00) 00010000:00010000:2.0:1788873809.739446:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873809.739450:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739456:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b84c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739488:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b83e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95cd expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739515:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95cd expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.739523:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:2.0:1788873809.739526:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873809.739529:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652e00, rc 0) 00000100:00100000:2.0:1788873809.739722:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:10505:x1875769840132480:12345-192.168.202.20@tcp:101:rm.0 Request processed in 1664us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873809.739890:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:0.0:1788873809.745107:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.745452:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840132736 00000100:00100000:1.0:1788873809.745463:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840132736 00000100:00100000:1.0:1788873809.745558:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 38 00000100:00100000:1.0:1788873809.745570:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+19:10505:x1875769840132736:12345-192.168.202.20@tcp:36:rm.0 00010000:00010000:1.0:1788873809.745627:0:8993:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788873809.745654:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652e00/0x25c660afb0a9b853 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95cd expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745887:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b7ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95b1 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745900:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:1.0:1788873809.745910:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9b814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95b8 expref: 17 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745919:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:1.0:1788873809.745922:0:8993:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873809.745945:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745959:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745968:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745979:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745986:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.745993:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.746111:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.746130:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.746138:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873809.747652:0:8993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788873809.747663:0:8993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346693457807ns, next at 347693455740ns, rc = 0 00010000:00010000:1.0:1788873809.747728:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.747741:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.747750:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.747759:0:8993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.747767:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.747774:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748078:0:8993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788873809.748103:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748109:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748129:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748134:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecae00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873809.748139:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748147:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748160:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:1.0:1788873809.748163:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788873809.748177:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748185:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9b868 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748225:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748232:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748237:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748242:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873809.748245:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748272:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748282:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:1.0:1788873809.748285:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873809.748288:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748294:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9b85a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873809.748305:0:8993:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cc67fa2 reply state 00000000f53fcc90 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748316:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.748321:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d33410dce00) 00010000:00010000:1.0:1788873809.748323:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873809.748326:0:8993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873809.748462:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840132736:12345-192.168.202.20@tcp:36:rm.0 Request processed in 2890us (3360us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788873809.748471:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 38 00010000:00010000:2.0:1788873809.752251:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873809.752272:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.752282:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873809.752286:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.752295:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.752311:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:2.0:1788873809.752313:0:10331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788873809.752318:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.752322:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9b86f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873809.752339:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873809.752496:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873809.752498:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873809.758439:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873809.758556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840132992 00000100:00100000:0.0:1788873809.758568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840132992 00000100:00100000:0.0:1788873809.758656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:0.0:1788873809.758690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840132992:12345-192.168.202.20@tcp:35:rm.0 00000100:00100000:0.0:1788873809.758982:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:10505:x1875769840132992:12345-192.168.202.20@tcp:35:rm.0 Request processed in 305us (550us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788873809.758990:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:2.0:1788873809.762870:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873809.762941:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840133248 00000100:00100000:1.0:1788873809.762952:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840133248 00000100:00100000:1.0:1788873809.763015:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 39 00000100:00100000:1.0:1788873809.763025:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+19:10505:x1875769840133248:12345-192.168.202.20@tcp:36:rm.0 00010000:00010000:1.0:1788873809.763082:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788873809.763110:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b830 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95c6 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763152:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b7ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95a3 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763164:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3460230d00) 00010000:00010000:1.0:1788873809.763191:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca000/0x25c660afb0a9b78f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9595 expref: 17 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763201:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7ad00) 00010000:00010000:1.0:1788873809.763242:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873809.763276:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763289:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763299:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763311:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763318:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763324:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763413:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763430:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763437:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873809.763658:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788873809.763684:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763691:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763696:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763701:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbe00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873809.763706:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763712:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763720:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d3341e7ae00) 00010000:00010000:1.0:1788873809.763722:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788873809.763726:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763731:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbe00/0x25c660afb0a9b884 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763747:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763759:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763764:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763769:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873809.763772:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763778:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763786:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3341e7a300) 00010000:00010000:1.0:1788873809.763789:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873809.763791:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763797:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb200/0x25c660afb0a9b876 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873809.763808:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0b54aaf reply state 0000000078eaaf4f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763818:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873809.763824:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3341e7a400) 00010000:00010000:1.0:1788873809.763827:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873809.763829:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873809.763899:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+18:10505:x1875769840133248:12345-192.168.202.20@tcp:36:rm.0 Request processed in 873us (1036us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788873809.763911:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 39 00010000:00010000:2.0:1788873810.030450:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873810.160791:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873810.160826:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859092736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873810.160918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873810.161764:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873810.161781:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859092864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873810.161826:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873810.161918:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092736 00000100:00100000:1.0:1788873810.161927:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092736 00000100:00100000:1.0:1788873810.161997:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092864 00000100:00100000:1.0:1788873810.162001:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092864 00000100:00100000:1.0:1788873810.162021:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788873810.162030:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859092736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873810.162063:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873810.162116:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859092736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873810.162123:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788873810.162156:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788873810.162163:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859092864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788873810.162174:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873810.162223:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859092864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873810.162230:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788873810.162265:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33435d1880 x1875769859092864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873810.162286:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859092864:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788873810.162319:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343805f80 x1875769859092736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873810.162332:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859092736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788873810.162666:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873810.671473:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859093120:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.671548:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873810.671600:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859093632:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.671621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873810.671645:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859094144:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.671681:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873810.671714:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788873810.671720:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859093248:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.671744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873810.671763:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859093760:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.671785:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873810.671802:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859094272:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.671821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873810.671858:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093120 00000100:00100000:0.0:1788873810.671867:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093120 00000100:00100000:0.0:1788873810.671913:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093632 00000100:00100000:0.0:1788873810.671916:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093632 00000100:00100000:0.0:1788873810.671939:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093760 00000100:00100000:0.0:1788873810.671948:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093760 00000100:00100000:0.0:1788873810.671969:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788873810.671977:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859093120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672027:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859093120:12345-0@lo:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.672034:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788873810.672051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788873810.672056:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859093632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672079:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859093632:12345-0@lo:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.672085:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788873810.672094:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788873810.672099:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859093760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672121:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859093760:12345-0@lo:400:kworker.0 Request processed in 22us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.672126:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788873810.672149:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094144 00000100:00100000:0.0:1788873810.672152:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094144 00000100:00100000:0.0:1788873810.672173:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094272 00000100:00100000:0.0:1788873810.672176:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094272 00000100:00100000:0.0:1788873810.672193:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788873810.672199:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859094144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672248:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859094144:12345-0@lo:400:kworker.0 Request processed in 49us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.672255:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788873810.672266:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788873810.672271:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859094272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672302:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859094272:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.672308:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788873810.672325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093248 00000100:00100000:0.0:1788873810.672329:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093248 00000100:00100000:0.0:1788873810.672353:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788873810.672359:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859093248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672391:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859093248:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.672397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788873810.672422:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873810.672426:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873810.672428:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873810.672468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859093248:0@lo:400:kworker.0 00010000:00080000:0.0:1788873810.672481:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbc380 x1875769859093760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873810.672491:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859093760:0@lo:400:kworker.0 00010000:00080000:0.0:1788873810.672501:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbf480 x1875769859094272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873810.672509:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859094272:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672519:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859093120:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.672527:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859093632:0@lo:400:kworker.0 00010000:00080000:0.0:1788873810.672535:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbdf80 x1875769859094144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873810.672555:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859094144:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672685:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859092992:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672724:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873810.672749:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859093504:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873810.672783:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859094016:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873810.672816:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788873810.672821:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859093376:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672839:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873810.672852:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859093888:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672868:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873810.672889:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859092992 00000100:00100000:1.0:1788873810.672893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859092992 00000100:00100000:1.0:1788873810.672921:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788873810.672926:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.672959:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859092992:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873810.672965:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788873810.672991:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093504 00000100:00100000:1.0:1788873810.672995:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093504 00000100:00100000:1.0:1788873810.673014:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788873810.673020:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859093504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.673047:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859093504:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873810.673053:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788873810.673079:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859092992:0@lo:400:kworker.0 00000100:00100000:1.0:1788873810.673097:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859093504:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.673769:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094016 00000100:00100000:0.0:1788873810.673775:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094016 00000100:00100000:0.0:1788873810.673841:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093376 00000100:00100000:0.0:1788873810.673844:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093376 00000100:00100000:0.0:1788873810.673861:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859093888 00000100:00100000:0.0:1788873810.673864:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859093888 00000100:00100000:0.0:1788873810.673880:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788873810.673888:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859094016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.673943:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859094016:12345-0@lo:400:kworker.0 Request processed in 56us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.673950:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788873810.673965:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788873810.673971:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859093376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.673998:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859093376:12345-0@lo:400:kworker.0 Request processed in 27us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.674004:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788873810.674015:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788873810.674021:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859093888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.674047:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859093888:12345-0@lo:400:kworker.0 Request processed in 27us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873810.674052:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788873810.674100:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859093376:0@lo:400:kworker.0 00000100:00100000:0.0:1788873810.674112:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859093888:0@lo:400:kworker.0 00010000:00080000:0.0:1788873810.674152:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbce00 x1875769859094016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873810.674162:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859094016:0@lo:400:kworker.0 00000100:00080000:1.0:1788873810.674362:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873810.674366:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788873811.054430:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873811.182440:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873811.182476:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859094400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873811.182580:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873811.182693:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094400 00000100:00100000:3.0:1788873811.182705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094400 00000100:00100000:3.0:1788873811.182770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788873811.182814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859094400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873811.182863:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873811.182926:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859094400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873811.182933:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788873811.183007:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859094400:0@lo:41:osp-pre-1-0.0 00000004:00080000:3.0:1788873811.183541:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348129334370ns, next at 349129330698ns, rc = 0 00000100:00100000:3.0:1788873811.183571:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859094528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873811.183614:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873811.183678:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094528 00000100:00100000:3.0:1788873811.183683:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094528 00000100:00100000:3.0:1788873811.183723:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788873811.183730:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859094528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873811.183757:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873811.184430:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859094528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 695us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873811.184442:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1788873811.184500:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f43b800 x1875769859094528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873811.184522:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859094528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873811.185516:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859094656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873811.185599:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873811.185826:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094656 00000100:00100000:0.0:1788873811.185837:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094656 00000100:00100000:0.0:1788873811.185896:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788873811.185908:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859094656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873811.185936:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873811.186059:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859094656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873811.186067:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788873811.186110:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbce00 x1875769859094656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873811.186131:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859094656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873811.592466:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873811.592566:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873811.592592:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873811.592628:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873811.592670:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873811.592701:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840133632 00000100:00100000:1.0:1788873811.592701:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840133376 00000100:00100000:2.0:1788873811.592715:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840133632 00000100:00100000:1.0:1788873811.592715:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840133376 00000100:00100000:2.0:1788873811.592772:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840133888 00000100:00100000:2.0:1788873811.592776:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840133888 00000100:00100000:1.0:1788873811.592778:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 337 00000100:00100000:1.0:1788873811.592789:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840133376:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873811.592798:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840133504 00000100:00100000:2.0:1788873811.592800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840133504 00000100:00100000:2.0:1788873811.592816:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 223 00000100:00100000:2.0:1788873811.592823:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840133632:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873811.592875:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 224 00000100:00100000:0.0:1788873811.592886:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840133888:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873811.593123:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840133632:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 299us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873811.593131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 223 00000100:00100000:1.0:1788873811.593193:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840133376:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 405us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873811.593201:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 337 00000100:00100000:2.0:1788873811.593244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 225 00000100:00100000:2.0:1788873811.593251:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2399:x1875769840133504:12345-192.168.202.20@tcp:400:kworker.0 00000100:00080000:1.0:1788873811.593270:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873811.593275:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873811.593283:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2399:x1875769840133504:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 33us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873811.593289:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 225 00000100:00100000:1.0:1788873811.593319:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840133760 00000100:00100000:1.0:1788873811.593323:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840133760 00000100:00100000:1.0:1788873811.593361:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 87 00000100:00100000:1.0:1788873811.593368:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840133760:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873811.593398:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840133760:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 30us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873811.593404:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 87 00000100:00080000:1.0:1788873811.593431:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873811.593477:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840133888:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 593us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873811.593484:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 224 00000100:00100000:3.0:1788873811.593518:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873811.593593:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134016 00000100:00100000:0.0:1788873811.593597:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134016 00000100:00100000:0.0:1788873811.593646:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 226 00000100:00100000:0.0:1788873811.593653:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840134016:12345-192.168.202.20@tcp:400:kworker.0 00000100:00080000:1.0:1788873811.593686:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873811.593691:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840134016:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873811.593707:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 226 00010000:00010000:0.0:1788873812.079574:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873813.103084:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873813.742611:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859094784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873813.742806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873813.743074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094784 00000100:00100000:0.0:1788873813.743087:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094784 00000100:00100000:0.0:1788873813.743174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788873813.743188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859094784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873813.743381:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873813.743470:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859094784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 284us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873813.743478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788873813.743576:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859094784:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788873814.023389:0:13678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788873814.129855:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788873814.772948:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788873814.773308:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788873814.773324:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788873814.773359:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773376:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773386:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773393:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873814.773398:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773407:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873814.773481:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859094912:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788873814.773497:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d33410dce00) 00010000:00010000:1.0:1788873814.773503:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873814.773508:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773515:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9b7e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773541:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773547:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773554:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773567:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873814.773571:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773579:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873814.773592:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873814.773593:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d33410dcc00) 00010000:00010000:1.0:1788873814.773599:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873814.773603:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773610:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9b7f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773646:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773653:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773658:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773664:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecac00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873814.773666:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773671:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773706:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d33410dce00) 00010000:00010000:1.0:1788873814.773709:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873814.773713:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773720:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b861 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873814.773729:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859094912 00010000:00010000:1.0:1788873814.773739:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773749:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873814.773755:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859094912 00010000:00010000:1.0:1788873814.773756:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773767:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873814.773770:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773777:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773787:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3341e7a400) 00010000:00010000:1.0:1788873814.773790:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873814.773794:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.773799:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b87d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873814.773853:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788873814.773867:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859094912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788873814.773906:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788873814.773954:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa00c52, atime: 0x6aa00c52, ctime: 0x6aa00c52, blocks: 0x0 00010000:00010000:0.0:1788873814.773962:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873814.773982:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1788873814.773987:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873814.773995:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873814.774036:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873814.774049:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873814.774056:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873814.774095:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788873814.774330:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859094912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 465us (741us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788873814.774338:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788873814.774367:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788873814.774414:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343bbd500/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788873814.774421:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859094912:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788873814.774693:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873814.774702:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.774712:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788873814.774716:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.774726:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.774763:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.774771:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9b88b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873814.774792:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873814.774794:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873814.774796:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873815.150431:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788873815.227460:0:13726:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe095d1020 20000000:00000080:2.0:1788873815.227493:0:13726:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347a73e400 uarg=0000000000000000 20000000:01000000:2.0:1788873815.227633:0:13726:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788873815.227643:0:13726:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788873815.227650:0:13726:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788873815.229088:0:13727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788873815.229459:0:13726:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788873815.245413:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788873815.245472:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788873815.245491:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788873815.245514:0:13726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788873815.245542:0:13726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245567:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245576:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245584:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245591:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245602:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245609:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245653:0:13726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245708:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245727:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 12 pid: 6505 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.245748:0:13726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095040:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873815.245895:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245904:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.245913:0:13726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095168:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873815.245946:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.245954:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 23 pid: 6506 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.245964:0:13726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095296:0@lo:104: 00000100:00100000:2.0:1788873815.246026:0:13726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873815.246061:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.246080:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.246089:0:13726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095424:0@lo:104: 00010000:00010000:2.0:1788873815.246112:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.246121:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 23 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.246128:0:13726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095552:0@lo:104: 00010000:00010000:2.0:1788873815.246150:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873815.246157:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 23 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.246165:0:13726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095680:0@lo:104: 00000100:00100000:2.0:1788873815.246185:0:13726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873815.248522:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788873815.248594:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.248638:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.248653:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.248667:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859095296 00000100:00100000:0.0:1788873815.248680:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859095296 00000100:00100000:0.0:1788873815.248735:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859095424 00000100:00100000:0.0:1788873815.248738:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859095424 00000100:00100000:0.0:1788873815.248750:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859095552 00000100:00100000:0.0:1788873815.248752:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859095552 00000100:00100000:0.0:1788873815.248759:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859095680 00000100:00100000:0.0:1788873815.248783:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859095680 00000100:00100000:0.0:1788873815.248803:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873815.248814:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:13726:x1875769859095296:12345-0@lo:104: 00010000:00010000:0.0:1788873815.248840:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.248952:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873815.248959:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+6:13726:x1875769859095296:12345-0@lo:104: Request processed in 147us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.248967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873815.249020:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873815.249027:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:13726:x1875769859095424:12345-0@lo:104: 00010000:00010000:0.0:1788873815.249035:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249082:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788873815.249087:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+5:13726:x1875769859095424:12345-0@lo:104: Request processed in 62us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.249094:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873815.249106:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873815.249111:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:13726:x1875769859095552:12345-0@lo:104: 00010000:00010000:0.0:1788873815.249120:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249153:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788873815.249158:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+4:13726:x1875769859095552:12345-0@lo:104: Request processed in 47us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.249163:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873815.249183:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788873815.249189:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:13726:x1875769859095680:12345-0@lo:104: 00010000:00010000:0.0:1788873815.249198:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249269:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788873815.249274:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+3:13726:x1875769859095680:12345-0@lo:104: Request processed in 86us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.249280:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788873815.249306:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788873815.249315:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249323:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873815.249329:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249341:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873815.249351:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873815.249357:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873815.249408:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249416:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873815.249441:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249461:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475ecbc00/0x25c660afb0a9b742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b749 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249479:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788873815.249482:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249489:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb800 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873815.249492:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249500:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873815.249507:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873815.249512:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873815.249527:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249534:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873815.249553:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249560:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9b734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b73b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249570:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788873815.249579:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249585:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873815.249588:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249595:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873815.249601:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873815.249607:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873815.249621:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249640:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873815.249648:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249655:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93000/0x25c660afb0a9b726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b72d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249665:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873815.249667:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249674:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873815.249677:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249694:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873815.249701:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873815.249706:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788873815.249721:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249727:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873815.249733:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249739:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92a00/0x25c660afb0a9b718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9b71f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.249754:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873815.249756:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873815.249758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873815.249766:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873815.249773:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873815.249801:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859095808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873815.249851:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.249900:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873815.249906:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859096192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873815.249929:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.249958:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859095936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873815.249989:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.250013:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873815.250019:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859096064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873815.250041:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.250087:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859095808 00000100:00100000:0.0:1788873815.250094:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859095808 00010000:00010000:0.0:1788873815.250122:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 24 pid: 6506 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873815.250143:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096192 00000100:00100000:0.0:1788873815.250146:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096192 00010000:00010000:0.0:1788873815.250159:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 25 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873815.250172:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859095936 00000100:00100000:0.0:1788873815.250175:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859095936 00000100:00100000:2.0:1788873815.250182:0:13726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095296:0@lo:104: 00010000:00010000:0.0:1788873815.250189:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 26 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.250200:0:13726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095424:0@lo:104: 00000100:00100000:0.0:1788873815.250226:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096064 00000100:00100000:0.0:1788873815.250230:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096064 00010000:00010000:0.0:1788873815.250244:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 27 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873815.250263:0:13726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095552:0@lo:104: 00000100:00100000:0.0:1788873815.250266:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788873815.250277:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+27:3634:x1875769859095808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873815.250290:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873815.250295:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 27 pid: 6506 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250318:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 27 pid: 6506 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250334:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92800/0x25c660afb0a9b749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b742 expref: 27 pid: 6506 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250349:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873815.250380:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+26:3634:x1875769859095808:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873815.250385:0:13726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095680:0@lo:104: 00000100:00100000:0.0:1788873815.250392:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788873815.250410:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788873815.250416:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+25:3634:x1875769859096192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873815.250424:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873815.250429:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 25 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250438:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 25 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250448:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9b71f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b718 expref: 25 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250458:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873815.250484:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859096192:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.250490:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788873815.250502:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788873815.250507:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3635:x1875769859095936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873815.250523:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873815.250528:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250536:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250545:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92000/0x25c660afb0a9b73b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b734 expref: 23 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250554:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873815.250591:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3635:x1875769859095936:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.250597:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788873815.250611:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788873815.250617:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3635:x1875769859096064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873815.250637:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873815.250642:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 21 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250650:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 21 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250660:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443a00/0x25c660afb0a9b72d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9b726 expref: 21 pid: 6505 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873815.250668:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873815.250692:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3635:x1875769859096064:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.250708:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788873815.250753:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859096192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873815.250762:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859095808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873815.250848:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859096064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873815.250857:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859095936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788873815.251067:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873815.255067:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873815.255325:0:13726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095040:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873815.255342:0:13726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875769859095168:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873815.255396:0:13726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873815.256845:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134272 00000100:00100000:3.0:1788873815.256865:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134272 00010000:00010000:3.0:1788873815.256937:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 13 pid: 6505 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873815.256993:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:3.0:1788873815.257007:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840134272:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873815.257028:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873815.257035:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 13 pid: 6505 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.257049:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 13 pid: 6505 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.257073:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9b757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9587 expref: 13 pid: 6505 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.257094:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873815.259874:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:2400:x1875769840134272:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 2848us (4802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873815.259904:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:1.0:1788873815.267376:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873815.267612:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134144 00000100:00100000:3.0:1788873815.267634:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134144 00010000:00010000:3.0:1788873815.267687:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873815.267775:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:3.0:1788873815.267787:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:2400:x1875769840134144:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873815.267805:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873815.267811:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267826:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267848:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443800/0x25c660afb0a9b750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9580 expref: 12 pid: 6503 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267869:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267878:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267906:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267914:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267922:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267929:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267947:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873815.267953:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267962:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267982:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873815.267994:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873815.268057:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:2400:x1875769840134144:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 271us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873815.268065:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 51 00010000:00010000:1.0:1788873815.268263:0:13726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873815.268273:0:13726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873815.268289:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b892 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873815.278858:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873815.278894:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859096320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873815.278995:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.279063:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096320 00000100:00100000:3.0:1788873815.279072:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096320 00000100:00100000:3.0:1788873815.279161:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788873815.279173:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859096320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873815.279246:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873815.279297:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859096320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873815.279305:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788873815.279329:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873815.279365:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f43a680 x1875769859096320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873815.279409:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859096320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873815.279566:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873815.279577:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859096448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873815.279613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.279660:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096448 00000100:00100000:0.0:1788873815.279664:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096448 00000100:00100000:0.0:1788873815.279694:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788873815.279700:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859096448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873815.279713:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873815.279745:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859096448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.279751:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788873815.279777:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbea00 x1875769859096448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873815.279791:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859096448:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788873815.280149:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873815.796525:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859096576:0@lo:400:kworker.0 00000100:00100000:2.0:1788873815.796731:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873815.796923:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096576 00000100:00100000:0.0:1788873815.796932:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096576 00000100:00100000:0.0:1788873815.797008:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788873815.797020:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859096576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.802034:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.802143:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.802198:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859097472:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.802250:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.802281:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788873815.802287:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859097088:0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.802512:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096960 00000100:00100000:1.0:1788873815.802523:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096960 00000100:00100000:1.0:1788873815.802647:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788873815.802659:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859096960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.802838:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859096960:12345-0@lo:400:kworker.0 Request processed in 180us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873815.802846:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788873815.802913:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.802945:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859097600:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.802974:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.803010:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803040:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859096704:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803063:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.803079:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859097216:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803099:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.803123:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859097728:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803144:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.803160:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788873815.803166:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859096832:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803185:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.803194:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859097344:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803233:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873815.803285:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097472 00000100:00100000:3.0:1788873815.803290:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097472 00000100:00100000:1.0:1788873815.803444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097088 00000100:00100000:1.0:1788873815.803448:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097088 00000100:00100000:1.0:1788873815.803484:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097216 00000100:00100000:1.0:1788873815.803487:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097216 00000100:00100000:3.0:1788873815.803522:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096832 00000100:00100000:3.0:1788873815.803525:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096832 00000100:00100000:3.0:1788873815.803535:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097344 00000100:00100000:3.0:1788873815.803537:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097344 00000100:00100000:3.0:1788873815.803563:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788873815.803570:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859097088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.803613:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859097088:12345-0@lo:400:kworker.0 Request processed in 44us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873815.803631:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788873815.803645:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788873815.803728:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788873815.803734:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859096832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.803770:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859096832:12345-0@lo:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873815.803777:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788873815.803787:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788873815.803792:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859097344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.803814:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859097344:12345-0@lo:400:kworker.0 Request processed in 22us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873815.803819:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788873815.803827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788873815.803832:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859097216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.803878:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859097216:12345-0@lo:400:kworker.0 Request processed in 46us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873815.803885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788873815.803903:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097600 00000100:00100000:1.0:1788873815.803906:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097600 00000100:00100000:1.0:1788873815.803931:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097728 00000100:00100000:1.0:1788873815.803933:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097728 00000100:00100000:1.0:1788873815.803950:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788873815.803955:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d344ff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859097600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.803984:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d344ff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859097600:12345-0@lo:400:kworker.0 Request processed in 28us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873815.803989:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788873815.804229:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859096576:12345-0@lo:400:kworker.0 Request processed in 7210us (7497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873815.804247:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788873815.804675:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859096576:0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.804815:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788873815.804825:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859097728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.804866:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859097728:12345-0@lo:400:kworker.0 Request processed in 45us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873815.804872:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788873815.804896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873815.804901:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873815.804904:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873815.804934:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859096832:0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.804945:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859097344:0@lo:400:kworker.0 00010000:00080000:1.0:1788873815.804962:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f43b100 x1875769859097216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873815.804974:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859097216:0@lo:400:kworker.0 00000100:00100000:1.0:1788873815.804996:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859097728:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.805125:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859097472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.805160:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859097472:12345-0@lo:400:kworker.0 Request processed in 1510us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873815.805167:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788873815.805189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859096704 00000100:00100000:3.0:1788873815.805195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859096704 00000100:00100000:3.0:1788873815.805252:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788873815.805259:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859096704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873815.805454:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859096704:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.805532:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859096704:12345-0@lo:400:kworker.0 Request processed in 39us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873815.805539:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788873815.805586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788873815.805601:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859097600:0@lo:400:kworker.0 00010000:00080000:3.0:1788873815.805615:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f43d180 x1875769859097472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873815.805652:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859097472:0@lo:400:kworker.0 00010000:00010000:0.0:1788873816.174863:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788873816.220355:0:13775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff45bb7130 20000000:00000080:2.0:1788873816.220373:0:13775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347a73d000 uarg=0000000000000000 20000000:01000000:2.0:1788873816.220420:0:13775:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788873816.220427:0:13775:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788873816.220432:0:13775:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788873816.223096:0:13776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788873816.223366:0:13775:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788873816.223470:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788873816.223500:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788873816.223515:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788873816.223526:0:13775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788873816.223551:0:13775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223569:0:13775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223581:0:13775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223589:0:13775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223611:0:13775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223628:0:13775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223634:0:13775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873816.223639:0:13775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223647:0:13775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223662:0:13775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223670:0:13775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.223676:0:13775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b899 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873816.304570:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788873816.304593:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859097856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873816.304679:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873816.306376:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097856 00000100:00100000:2.0:1788873816.306391:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097856 00000100:00100000:2.0:1788873816.306462:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788873816.306473:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859097856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873816.306518:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873816.306808:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859097856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 336us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.306816:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788873816.306911:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859097856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873816.313508:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859097984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873816.313849:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.314305:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859097984 00000100:00100000:1.0:1788873816.314314:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859097984 00000100:00100000:1.0:1788873816.314374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788873816.314385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859097984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873816.314421:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873816.314476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859097984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.314483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788873816.314541:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859097984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873816.314904:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873816.314916:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859098112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873816.314953:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873816.316743:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098112 00000100:00100000:3.0:1788873816.316753:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098112 00000100:00100000:3.0:1788873816.316825:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788873816.316835:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875769859098112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873816.316858:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873816.316926:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875769859098112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.316932:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788873816.317006:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873816.317051:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859098112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873816.584434:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873816.584623:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134400 00000100:00100000:2.0:1788873816.584634:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134400 00000100:00100000:2.0:1788873816.584695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 338 00000100:00100000:2.0:1788873816.584706:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:6175:x1875769840134400:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873816.584732:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873816.584754:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b8a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a95d4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.584782:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b8a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95d4 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.584794:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b8a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95d4 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.584804:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653600, rc 0) 00000100:00100000:2.0:1788873816.584862:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840134400:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 158us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.584869:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 338 00000100:00100000:0.0:1788873816.588260:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873816.588409:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134528 00000100:00100000:1.0:1788873816.588420:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134528 00000100:00100000:1.0:1788873816.588488:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 339 00000100:00100000:1.0:1788873816.588499:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840134528:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.588668:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840134528:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.588676:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 339 00000100:00100000:0.0:1788873816.603727:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873816.603823:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134656 00000100:00100000:1.0:1788873816.603847:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134656 00000100:00100000:1.0:1788873816.603909:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 340 00000100:00100000:1.0:1788873816.603919:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840134656:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.604079:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840134656:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 161us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.604088:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 340 00000100:00100000:3.0:1788873816.607825:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873816.608325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134784 00000100:00100000:2.0:1788873816.608335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134784 00000100:00100000:2.0:1788873816.608396:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 341 00000100:00100000:2.0:1788873816.608406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:10789:x1875769840134784:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788873816.608687:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:10789:x1875769840134784:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 280us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.608700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 341 00000100:00100000:0.0:1788873816.635320:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873816.635422:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840134912 00000100:00100000:2.0:1788873816.635434:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840134912 00000100:00100000:2.0:1788873816.635643:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 342 00000100:00100000:2.0:1788873816.635655:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:10789:x1875769840134912:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788873816.635824:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:10789:x1875769840134912:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 171us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.635832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 342 00000100:00100000:0.0:1788873816.660595:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873816.660921:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135040 00000100:00100000:1.0:1788873816.660934:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135040 00000100:00100000:1.0:1788873816.661030:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 343 00000100:00100000:1.0:1788873816.661043:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:6175:x1875769840135040:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873816.661116:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873816.661137:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475ecaa00/0x25c660afb0a9b8a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a95db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.661170:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecaa00/0x25c660afb0a9b8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95db expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.661179:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475ecaa00/0x25c660afb0a9b8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95db expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.661187:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecaa00, rc 0) 00000100:00100000:1.0:1788873816.661279:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840135040:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 240us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.661285:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 343 00000100:00100000:3.0:1788873816.669733:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873816.669845:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135168 00000100:00100000:2.0:1788873816.669856:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135168 00000100:00100000:2.0:1788873816.669918:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 344 00000100:00100000:2.0:1788873816.669929:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840135168:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.670090:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840135168:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 162us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.670099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 344 00000100:00100000:0.0:1788873816.673400:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873816.673481:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135296 00000100:00100000:1.0:1788873816.673493:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135296 00000100:00100000:2.0:1788873816.673745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 345 00000100:00100000:2.0:1788873816.673758:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840135296:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.673925:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:6175:x1875769840135296:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 168us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.673932:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 345 00000100:00100000:0.0:1788873816.682831:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873816.683691:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135424 00000100:00100000:2.0:1788873816.683703:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135424 00000100:00100000:2.0:1788873816.683763:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 346 00000100:00100000:2.0:1788873816.683772:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:10792:x1875769840135424:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788873816.683927:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:10792:x1875769840135424:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 155us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.683935:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 346 10000000:01000000:0.0:1788873816.686603:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788873816.686621:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3341ecd800 from 7 10000000:01000000:0.0:1788873816.686626:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873816.686671:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873816.686682:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873816.686692:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873816.686716:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788873816.686792:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873816.686854:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.686858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098240 00000100:00100000:1.0:1788873816.686867:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098240 00000100:00100000:1.0:1788873816.686980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788873816.686991:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:6508:x1875769859098240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873816.687006:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873816.687021:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475eca800/0x25c660afb0a9b8b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b8ae expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.687046:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475eca800/0x25c660afb0a9b8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b8ae expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.687058:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475eca800/0x25c660afb0a9b8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b8ae expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.687068:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca800, rc 0) 00000100:00100000:1.0:1788873816.687121:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859098240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.687128:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788873816.687247:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873816.687262:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873816.687278:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873816.687351:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873816.687379:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873816.687773:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.688007:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098368 00000100:00100000:2.0:1788873816.688014:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098368 00000100:00100000:2.0:1788873816.688046:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788873816.688055:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859098368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.688194:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859098368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.688201:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788873816.688414:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873816.688450:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873816.688512:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873816.688541:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f4886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.688595:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098496 00000100:00100000:2.0:1788873816.688600:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098496 00000100:00100000:2.0:1788873816.688630:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788873816.688637:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859098496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.688720:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859098496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.688727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788873816.688860:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873816.689259:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13788:1875769859098624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873816.689453:0:13788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873816.689490:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.689542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098624 00000100:00100000:2.0:1788873816.689547:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098624 00000100:00100000:2.0:1788873816.689571:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788873816.689577:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:13788:x1875769859098624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873816.689680:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:13788:x1875769859098624:12345-0@lo:502:llog_process_th.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.689687:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788873816.689892:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13788:1875769859098624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788873816.689916:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873816.689926:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873816.689928:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788873816.689935:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3341ecd800 00000020:00000080:0.0:1788873816.689938:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788873816.690002:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873816.690007:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873816.690008:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788873816.690011:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873816.690013:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873816.690020:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788873816.690025:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3341ecd800 00000020:00000080:0.0:1788873816.690027:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788873816.690063:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13788:1875769859098752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873816.690098:0:13788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873816.690113:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343a5f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.693414:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098752 00000100:00100000:1.0:1788873816.693429:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098752 00000100:00100000:1.0:1788873816.693483:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788873816.693493:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:13788:x1875769859098752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873816.693739:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:13788:x1875769859098752:12345-0@lo:502:llog_process_th.0 Request processed in 247us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.693746:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788873816.693807:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13788:1875769859098752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788873816.693840:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873816.693850:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873816.693852:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788873816.693857:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788873816.694110:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788873816.694195:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788873816.694225:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694237:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873816.694246:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788873816.694249:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3476df3800 from 7 10000000:01000000:2.0:1788873816.694252:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788873816.694279:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694509:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694520:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873816.694542:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.694585:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873816.694626:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.694642:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859098880 00000100:00100000:2.0:1788873816.694645:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859098880 00000100:00100000:2.0:1788873816.694669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788873816.694676:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:6508:x1875769859098880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873816.694686:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873816.694697:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441652000/0x25c660afb0a9b8c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b8bc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694728:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441652000/0x25c660afb0a9b8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b8bc expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694739:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441652000/0x25c660afb0a9b8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b8bc expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694747:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652000, rc 0) 00000100:00100000:2.0:1788873816.694779:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859098880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.694784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788873816.694814:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859098880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873816.694827:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873816.694835:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873816.694883:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.694907:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873816.694915:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.694930:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099008 00000100:00100000:2.0:1788873816.694934:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099008 00000100:00100000:2.0:1788873816.694948:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788873816.694953:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859099008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.695043:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859099008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.695057:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788873816.695079:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.695100:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.695131:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873816.695138:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.695152:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099136 00000100:00100000:2.0:1788873816.695155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099136 00000100:00100000:2.0:1788873816.695559:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788873816.695567:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859099136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.695650:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859099136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.695657:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788873816.695693:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788873816.700635:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873816.700762:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13790:1875769859099264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873816.700821:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873816.700852:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135552 00000100:00100000:2.0:1788873816.700858:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135552 00000100:00100000:2.0:1788873816.700888:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099264 00000100:00100000:2.0:1788873816.700891:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099264 00000100:00100000:2.0:1788873816.700906:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 355 00000100:00100000:2.0:1788873816.700914:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:10792:x1875769840135552:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788873816.701055:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:10792:x1875769840135552:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.701073:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 355 00000100:00100000:2.0:1788873816.701103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788873816.701110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:13790:x1875769859099264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873816.701386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:13790:x1875769859099264:12345-0@lo:502:llog_process_th.0 Request processed in 276us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.701393:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788873816.702312:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33439f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.702345:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13790:1875769859099264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788873816.702382:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873816.702392:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873816.702394:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788873816.702401:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3476df3800 00000020:00000080:1.0:1788873816.702403:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788873816.702456:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873816.702469:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873816.702471:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788873816.702473:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873816.702476:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873816.702478:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788873816.702481:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3476df3800 00000020:00000080:1.0:1788873816.702483:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788873816.702526:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13790:1875769859099392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873816.702583:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.702625:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099392 00000100:00100000:1.0:1788873816.702631:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099392 00000100:00100000:1.0:1788873816.702670:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788873816.702678:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:13790:x1875769859099392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873816.702781:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:13790:x1875769859099392:12345-0@lo:502:llog_process_th.0 Request processed in 103us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.702788:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788873816.702836:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.702848:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13790:1875769859099392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788873816.702865:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873816.702869:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873816.702875:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788873816.702879:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788873816.702975:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788873816.702998:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873816.703009:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.703020:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873816.703031:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788873816.703034:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34651cb800 from 7 10000000:01000000:1.0:1788873816.703037:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873816.703063:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.703071:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.703081:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873816.703094:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.703134:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.703147:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.703158:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099520 00000100:00100000:1.0:1788873816.703825:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099520 00000100:00100000:1.0:1788873816.703859:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788873816.703867:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:6508:x1875769859099520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873816.703878:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873816.703901:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9b8d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b8ca expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.703927:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9b8d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b8ca expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.703939:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9b8d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b8ca expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.703948:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecbe00, rc 0) 00000100:00100000:1.0:1788873816.703993:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859099520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.704000:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788873816.704043:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873816.704061:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.704070:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873816.704276:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.704719:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.704740:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.704758:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099648 00000100:00100000:1.0:1788873816.704762:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099648 00000100:00100000:1.0:1788873816.704785:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788873816.704791:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859099648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.704903:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859099648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.704920:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788873816.704955:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.704987:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.705027:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.705040:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.705051:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099776 00000100:00100000:1.0:1788873816.705054:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099776 00000100:00100000:1.0:1788873816.705069:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788873816.705074:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859099776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.706455:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859099776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1375us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.706799:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788873816.706863:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859099776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.708995:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13792:1875769859099904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873816.709078:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873816.711537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859099904 00000100:00100000:2.0:1788873816.711549:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859099904 00000100:00100000:1.0:1788873816.713771:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de600 going to sleep for 11 seconds 00000100:00100000:2.0:1788873816.713866:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788873816.713879:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:13792:x1875769859099904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873816.714090:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:13792:x1875769859099904:12345-0@lo:502:llog_process_th.0 Request processed in 215us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873816.714097:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788873816.714427:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13792:1875769859099904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788873816.714585:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873816.714598:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873816.714600:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788873816.714619:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d34651cb800 00000020:00000080:0.0:1788873816.714622:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788873816.714682:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873816.714686:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873816.714688:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788873816.714691:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873816.714693:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873816.714694:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788873816.714697:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d34651cb800 00000020:00000080:0.0:1788873816.714699:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788873816.714748:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13792:1875769859100032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873816.714786:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873816.715309:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343a5f240 going to sleep for 11 seconds 00000040:00080000:2.0:1788873816.716253:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788873816.717012:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873816.717056:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873816.717071:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873816.717084:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873816.717149:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873816.717179:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135936 00000100:00100000:3.0:1788873816.717188:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135936 00000100:00100000:3.0:1788873816.717269:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00100000:3.0:1788873816.717279:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840135936:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873816.717840:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840135936:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 559us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.717850:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00100000:3.0:1788873816.717894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135680 00000100:00100000:3.0:1788873816.717897:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135680 00000100:00100000:3.0:1788873816.717916:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136192 00000100:00100000:3.0:1788873816.717918:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136192 00000100:00100000:3.0:1788873816.717926:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840135808 00000100:00100000:3.0:1788873816.717927:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840135808 00000100:00100000:3.0:1788873816.717934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136064 00000100:00100000:3.0:1788873816.717935:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136064 00000100:00100000:3.0:1788873816.717944:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 233 00000100:00100000:3.0:1788873816.717948:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840135680:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873816.717973:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840135680:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.717979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 233 00000100:00100000:3.0:1788873816.717989:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 234 00000100:00100000:3.0:1788873816.717995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840136192:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873816.718020:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840136192:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.718026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 234 00000100:00100000:3.0:1788873816.718037:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 235 00000100:00100000:3.0:1788873816.718043:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840135808:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873816.718060:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840135808:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 18us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.718064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 235 00000100:00100000:3.0:1788873816.718071:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 236 00000100:00100000:3.0:1788873816.718074:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840136064:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873816.718087:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840136064:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 13us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.718096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 236 00000100:00080000:3.0:1788873816.718113:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873816.718116:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873816.718118:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873816.719562:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100032 00000100:00100000:1.0:1788873816.719575:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100032 00000100:00100000:1.0:1788873816.719649:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788873816.719659:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:13792:x1875769859100032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873816.720084:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:13792:x1875769859100032:12345-0@lo:502:llog_process_th.0 Request processed in 425us (5295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.720093:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788873816.721337:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13792:1875769859100032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788873816.721383:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873816.721393:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873816.721395:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788873816.721399:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788873816.722964:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788873816.723008:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873816.723021:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.723033:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873816.723042:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788873816.723045:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d34473c7800 from 7 10000000:01000000:1.0:1788873816.723047:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873816.723084:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.723091:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.723102:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873816.723129:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859100160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.723193:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.723261:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de600 going to sleep for 11 seconds 00000100:00100000:0.0:1788873816.723396:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100160 00000100:00100000:0.0:1788873816.723404:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100160 00000100:00100000:0.0:1788873816.723455:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788873816.723657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:6508:x1875769859100160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873816.723670:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873816.723682:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd92e00/0x25c660afb0a9b8df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9b8d8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873816.723712:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd92e00/0x25c660afb0a9b8df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9b8d8 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873816.723722:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd92e00/0x25c660afb0a9b8df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9b8d8 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873816.723729:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92e00, rc 0) 00000100:00100000:0.0:1788873816.723774:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859100160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873816.723780:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788873816.723924:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859100160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873816.723938:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873816.723948:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873816.724002:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859100288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.724035:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.724064:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de600 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.724077:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100288 00000100:00100000:1.0:1788873816.724081:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100288 00000100:00100000:1.0:1788873816.724115:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788873816.724121:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859100288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.724252:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859100288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.724259:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788873816.724302:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859100288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.724341:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859100416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.724380:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873816.724392:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de600 going to sleep for 11 seconds 00000100:00100000:1.0:1788873816.724402:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100416 00000100:00100000:1.0:1788873816.724405:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100416 00000100:00100000:1.0:1788873816.724418:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788873816.724423:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859100416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788873816.725232:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:6508:x1875769859100416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 804us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873816.725240:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788873816.725341:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7574ef44-222c-4adf-9b21-6aa184f7ffdf:6508:1875769859100416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873816.728941:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13794:1875769859100544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873816.729025:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873816.729069:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100544 00000100:00100000:3.0:1788873816.729075:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100544 00000100:00100000:3.0:1788873816.729130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788873816.729139:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:13794:x1875769859100544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873816.729454:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:13794:x1875769859100544:12345-0@lo:502:llog_process_th.0 Request processed in 315us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.729525:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788873816.729574:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873816.729595:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13794:1875769859100544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873816.729634:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873816.729643:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873816.729645:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873816.729651:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d34473c7800 00000020:00000080:3.0:1788873816.729653:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873816.729693:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873816.729696:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873816.729698:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873816.729700:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873816.729702:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873816.729709:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788873816.729714:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d34473c7800 00000020:00000080:3.0:1788873816.729716:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788873816.729749:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13794:1875769859100672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873816.729782:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873816.729804:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100672 00000100:00100000:3.0:1788873816.729808:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100672 00000100:00100000:3.0:1788873816.729828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788873816.729834:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:13794:x1875769859100672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873816.729896:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:13794:x1875769859100672:12345-0@lo:502:llog_process_th.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873816.729902:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788873816.729927:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873816.729937:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7574ef44-222c-4adf-9b21-6aa184f7ffdf:13794:1875769859100672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873816.729953:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873816.729957:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873816.729959:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788873816.729962:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788873816.730031:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788873816.730055:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873816.730064:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873816.730076:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873816.758456:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788873817.199429:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788873817.775013:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788873817.775909:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788873818.222653:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873818.864252:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859100800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873818.864334:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873818.864780:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100800 00000100:00100000:3.0:1788873818.864789:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100800 00000100:00100000:3.0:1788873818.864859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788873818.864871:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859100800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873818.864904:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788873818.865719:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859100800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 847us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873818.865728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788873818.865802:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859100800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788873819.246410:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873820.270310:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873820.398635:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859100928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873820.398721:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873820.398900:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859100928 00000100:00100000:2.0:1788873820.398908:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859100928 00000100:00100000:2.0:1788873820.398975:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788873820.398987:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859100928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873820.399014:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873820.399073:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859100928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873820.399080:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788873820.399355:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873820.399384:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbd180 x1875769859100928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873820.399417:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859100928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873820.400857:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859101056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873820.400922:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873820.401014:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101056 00000100:00100000:1.0:1788873820.401022:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101056 00000100:00100000:1.0:1788873820.401076:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788873820.401085:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859101056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873820.401105:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873820.401145:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859101056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873820.401152:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788873820.401170:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788873820.401193:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a35500 x1875769859101056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873820.401235:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859101056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873820.911874:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859101184:0@lo:400:kworker.0 00000100:00100000:2.0:1788873820.911961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873820.912018:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859101696:0@lo:400:kworker.0 00000100:00100000:2.0:1788873820.912045:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873820.912065:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859102208:0@lo:400:kworker.0 00000100:00100000:2.0:1788873820.912088:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873820.912113:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788873820.912119:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859101568:0@lo:400:kworker.0 00000100:00100000:2.0:1788873820.912141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873820.912166:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859102080:0@lo:400:kworker.0 00000100:00100000:2.0:1788873820.912186:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873820.912732:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859101440:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.912770:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873820.912793:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859101952:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.912814:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873820.912832:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859102464:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.912854:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873820.912873:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788873820.912879:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859101312:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.912922:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873820.913123:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102208 00000100:00100000:0.0:1788873820.913133:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102208 00000100:00100000:2.0:1788873820.913166:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101696 00000100:00100000:2.0:1788873820.913171:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101696 00000100:00080000:0.0:1788873820.913222:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873820.913262:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101440 00000100:00100000:2.0:1788873820.913266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101440 00000100:00100000:2.0:1788873820.913284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788873820.913292:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859101696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873820.913369:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859101696:12345-0@lo:400:kworker.0 Request processed in 76us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873820.913376:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788873820.913402:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788873820.913409:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859101440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913427:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101568 00000100:00100000:0.0:1788873820.913431:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101568 00000100:00100000:2.0:1788873820.913437:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859101440:12345-0@lo:400:kworker.0 Request processed in 29us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913443:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102080 00000100:00100000:0.0:1788873820.913445:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102080 00000100:00100000:2.0:1788873820.913449:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788873820.913461:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101952 00000100:00100000:0.0:1788873820.913464:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101952 00000100:00100000:0.0:1788873820.913476:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101312 00000100:00100000:0.0:1788873820.913484:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101312 00000100:00100000:0.0:1788873820.913501:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788873820.913507:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875769859102208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913542:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875769859102208:12345-0@lo:400:kworker.0 Request processed in 36us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913548:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788873820.913565:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788873820.913580:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859101568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913607:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859101568:12345-0@lo:400:kworker.0 Request processed in 37us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913613:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788873820.913624:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788873820.913631:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859102080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913658:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859102080:12345-0@lo:400:kworker.0 Request processed in 29us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913664:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788873820.913674:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788873820.913686:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859101952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913711:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859101952:12345-0@lo:400:kworker.0 Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913717:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788873820.913724:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859101824:0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913728:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788873820.913733:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859101312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.913751:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873820.913758:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859101312:12345-0@lo:400:kworker.0 Request processed in 25us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873820.913762:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859102336:0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788873820.913782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873820.913783:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101824 00000100:00100000:0.0:1788873820.913786:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101824 00000100:00100000:0.0:1788873820.913801:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788873820.913806:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859101824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.913816:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859101440:0@lo:400:kworker.0 00010000:00080000:1.0:1788873820.913829:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f43b100 x1875769859101952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873820.913830:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859101824:12345-0@lo:400:kworker.0 Request processed in 24us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913836:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788873820.913839:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859101952:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.913864:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859101312:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.913874:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859101824:0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.913897:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102464 00000100:00080000:0.0:1788873820.913897:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873820.913900:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102464 00000100:00080000:0.0:1788873820.913900:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873820.913922:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873820.913936:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788873820.913943:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1875769859102464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.913978:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1875769859102464:12345-0@lo:400:kworker.0 Request processed in 36us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873820.913984:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788873820.914059:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859101184 00000100:00100000:3.0:1788873820.914064:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859101184 00000100:00100000:3.0:1788873820.914095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788873820.914102:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859101184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873820.914141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859101184:12345-0@lo:400:kworker.0 Request processed in 40us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873820.914147:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788873820.914229:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102336 00000100:00100000:1.0:1788873820.914234:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102336 00000100:00100000:1.0:1788873820.914265:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788873820.914272:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859102336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873820.914303:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859102336:12345-0@lo:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873820.914309:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788873820.915582:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859102336:0@lo:400:kworker.0 00000100:00100000:0.0:1788873820.915599:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859102464:0@lo:400:kworker.0 00000100:00080000:0.0:1788873820.915629:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873820.926191:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859101568:0@lo:400:kworker.0 00000100:00100000:3.0:1788873820.926223:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859102080:0@lo:400:kworker.0 00000100:00100000:3.0:1788873820.926234:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859101184:0@lo:400:kworker.0 00000100:00100000:3.0:1788873820.926245:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859101696:0@lo:400:kworker.0 00010000:00080000:3.0:1788873820.926259:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f438e00 x1875769859102208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873820.926269:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859102208:0@lo:400:kworker.0 00000001:00080000:0.0:1788873820.936863:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788873821.303823:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873821.422560:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873821.422594:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859102592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873821.422668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873821.422709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102592 00000100:00100000:0.0:1788873821.422718:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102592 00000100:00100000:2.0:1788873821.422742:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859102720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873821.422768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788873821.422778:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859102592:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873821.422786:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788873821.422817:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788873821.422824:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102720 00000100:00100000:2.0:1788873821.422828:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102720 00000100:00100000:2.0:1788873821.422857:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788873821.422865:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859102720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788873821.422886:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873821.422911:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859102592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873821.422920:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788873821.422927:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859102720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873821.422935:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873821.422977:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788873821.422983:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343bbd500, transno 4294967301 00000100:00100000:0.0:1788873821.423006:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859102720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873821.423025:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859102592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873821.423264:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859102848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873821.423296:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873821.423510:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102848 00000100:00100000:1.0:1788873821.423515:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102848 00000100:00100000:1.0:1788873821.423554:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788873821.423562:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859102848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873821.423595:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873821.423641:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859102848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873821.423649:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788873821.423802:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859102848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873821.842325:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873821.842382:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873821.842421:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873821.842450:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873821.842510:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136576 00000100:00100000:2.0:1788873821.842521:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136576 00000100:00100000:2.0:1788873821.842603:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136832 00000100:00100000:2.0:1788873821.842606:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136832 00000100:00100000:2.0:1788873821.842637:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136448 00000100:00100000:2.0:1788873821.842640:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136448 00000100:00100000:3.0:1788873821.842652:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873821.842659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 243 00000100:00100000:2.0:1788873821.842668:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840136576:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873821.842678:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873821.842742:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840136576:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873821.842749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 243 00000100:00100000:2.0:1788873821.842771:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136960 00000100:00100000:2.0:1788873821.842779:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136960 00000100:00100000:2.0:1788873821.842797:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 244 00000100:00100000:2.0:1788873821.842804:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840136832:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873821.842811:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 245 00000100:00100000:3.0:1788873821.842818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840136448:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873821.842829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840136832:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873821.842835:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 244 00000100:00100000:3.0:1788873821.842838:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840136448:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873821.842844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 245 00000100:00100000:2.0:1788873821.842848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 246 00000100:00100000:2.0:1788873821.842854:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840136960:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873821.842875:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840136960:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 21us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873821.842881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 246 00000100:00100000:0.0:1788873821.843755:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136320 00000100:00100000:0.0:1788873821.843763:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136320 00000100:00100000:0.0:1788873821.843810:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 369 00000100:00100000:0.0:1788873821.843818:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840136320:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873821.843859:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840136320:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 42us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873821.843865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 369 00000100:00080000:0.0:1788873821.843894:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873821.843898:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873821.843907:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840136704 00000100:00100000:0.0:1788873821.843910:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840136704 00000100:00100000:0.0:1788873821.843940:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 93 00000100:00100000:0.0:1788873821.843947:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840136704:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873821.843974:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840136704:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873821.843991:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 93 00000100:00080000:0.0:1788873821.844083:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788873822.318438:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873823.342462:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873823.987828:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859102976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873823.987911:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873823.988135:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859102976 00000100:00100000:2.0:1788873823.988143:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859102976 00000100:00100000:2.0:1788873823.988233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788873823.988244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859102976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873823.988287:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788873823.988352:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859102976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873823.988359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788873823.988444:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859102976:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788873824.367095:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873825.390389:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873825.518560:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873825.518595:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859103104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873825.518668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873825.518753:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859103232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873825.518777:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873825.518874:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103104 00000100:00100000:2.0:1788873825.518881:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103104 00000100:00100000:2.0:1788873825.518946:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103232 00000100:00100000:2.0:1788873825.518949:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103232 00000100:00100000:2.0:1788873825.518966:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788873825.518973:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859103104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873825.519014:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873825.519060:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859103104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873825.519066:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788873825.519088:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788873825.519094:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859103232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873825.519104:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873825.519126:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859103232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873825.519132:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1788873825.519358:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873825.519392:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a37800 x1875769859103232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873825.519413:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859103232:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788873825.519425:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbc700 x1875769859103104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873825.519437:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859103104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873826.030588:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859103360:0@lo:400:kworker.0 00000100:00100000:1.0:1788873826.030683:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873826.030852:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103360 00000100:00100000:2.0:1788873826.030862:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103360 00000100:00100000:2.0:1788873826.030924:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788873826.030937:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859103360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.031182:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859103488:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.031238:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873826.031287:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103488 00000100:00100000:3.0:1788873826.031307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103488 00000100:00100000:3.0:1788873826.031338:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788873826.031345:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859103488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.031385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859103488:12345-0@lo:400:kworker.0 Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873826.031393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788873826.031444:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859103488:0@lo:400:kworker.0 00000100:00100000:2.0:1788873826.031879:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859103360:12345-0@lo:400:kworker.0 Request processed in 944us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873826.031889:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788873826.032103:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859104000:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032142:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873826.032181:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859104512:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873826.032243:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788873826.032249:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859103872:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032290:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873826.032309:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859104384:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032329:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873826.032352:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104000 00000100:00100000:0.0:1788873826.032357:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104000 00000100:00100000:0.0:1788873826.032391:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104384 00000100:00100000:0.0:1788873826.032394:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104384 00000100:00100000:0.0:1788873826.032409:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788873826.032416:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859104000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032454:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859104000:12345-0@lo:400:kworker.0 Request processed in 39us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.032460:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788873826.032475:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788873826.032480:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032508:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859104384:12345-0@lo:400:kworker.0 Request processed in 28us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.032536:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788873826.032558:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104512 00000100:00100000:0.0:1788873826.032562:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104512 00000100:00100000:0.0:1788873826.032590:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788873826.032596:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859104512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032627:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859104512:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.032633:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788873826.032650:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103872 00000100:00100000:0.0:1788873826.032654:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103872 00000100:00100000:0.0:1788873826.032677:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788873826.032683:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859103872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.032715:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859103872:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.032721:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788873826.032752:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859103872:0@lo:400:kworker.0 00010000:00080000:0.0:1788873826.032767:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1ed80 x1875769859104384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788873826.032909:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873826.032915:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873826.032917:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873826.032931:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859103744:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.032959:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873826.032983:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859104256:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033002:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873826.033021:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788873826.033026:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859103616:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033045:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873826.033060:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859104128:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873826.033092:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859104640:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873826.033136:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104640 00000100:00100000:3.0:1788873826.033140:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104640 00000100:00100000:3.0:1788873826.033172:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788873826.033178:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859104640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033234:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859104640:12345-0@lo:400:kworker.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873826.033250:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788873826.033271:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103616 00000100:00100000:3.0:1788873826.033275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103616 00000100:00100000:3.0:1788873826.033298:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788873826.033304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859103616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033337:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859103616:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873826.033342:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788873826.033358:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859103744 00000100:00100000:3.0:1788873826.033362:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859103744 00000100:00100000:3.0:1788873826.033380:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104256 00000100:00100000:3.0:1788873826.033382:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104256 00000100:00100000:3.0:1788873826.033398:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104128 00000100:00100000:3.0:1788873826.033401:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104128 00000100:00100000:3.0:1788873826.033417:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788873826.033424:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859103744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033463:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859103744:12345-0@lo:400:kworker.0 Request processed in 40us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873826.033470:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788873826.033483:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788873826.033490:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859104256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033536:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859104256:12345-0@lo:400:kworker.0 Request processed in 45us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873826.033543:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788873826.033557:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788873826.033565:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859104128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033617:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859104128:12345-0@lo:400:kworker.0 Request processed in 52us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873826.033624:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:3.0:1788873826.033643:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873826.033646:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873826.033649:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873826.033686:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859103616:0@lo:400:kworker.0 00010000:00080000:3.0:1788873826.033701:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3480e1f480 x1875769859104128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873826.033710:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859104128:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033720:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859104640:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033728:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859103744:0@lo:400:kworker.0 00000100:00100000:3.0:1788873826.033736:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859104256:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.034162:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859104384:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.034182:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859104000:0@lo:400:kworker.0 00000100:00100000:0.0:1788873826.034195:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859104512:0@lo:400:kworker.0 00000100:00100000:1.0:1788873826.035255:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859103360:0@lo:400:kworker.0 00010000:00010000:0.0:1788873826.414658:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873826.545741:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873826.545765:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859104768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873826.545779:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873826.545789:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859104896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873826.545842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873826.545842:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873826.546078:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873826.546090:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859105024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873826.548325:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873826.548431:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104896 00000100:00100000:0.0:1788873826.548443:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104896 00000100:00100000:0.0:1788873826.548493:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105024 00000100:00100000:0.0:1788873826.548496:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105024 00000100:00100000:0.0:1788873826.548514:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788873826.548535:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859104896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873826.548572:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873826.548646:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859104896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.548653:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788873826.548671:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873826.548678:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859105024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873826.548688:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873826.548722:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859105024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.548728:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873826.548774:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3480e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859105024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873826.548902:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859104896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873826.551341:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859104768 00000100:00100000:2.0:1788873826.551355:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859104768 00000100:00100000:2.0:1788873826.551412:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788873826.551421:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859104768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873826.551458:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788873826.551580:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859104768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (5737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873826.551601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788873826.554737:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859104768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873826.952557:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873826.952678:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873826.952714:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873826.952771:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137472 00000100:00100000:1.0:1788873826.952784:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137472 00000100:00100000:1.0:1788873826.952862:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 96 00000100:00100000:1.0:1788873826.952872:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840137472:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873826.952952:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840137472:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873826.952960:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 96 00000100:00080000:2.0:1788873826.953067:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873826.954974:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873826.955024:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873826.955067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137088 00000100:00100000:1.0:1788873826.955086:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137088 00000100:00100000:1.0:1788873826.955135:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 371 00000100:00100000:1.0:1788873826.955145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840137088:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873826.955238:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840137088:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873826.955246:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 371 00000100:00100000:0.0:1788873826.956071:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137216 00000100:00100000:0.0:1788873826.956139:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137216 00000100:00100000:0.0:1788873826.956337:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137728 00000100:00100000:0.0:1788873826.956342:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137728 00000100:00100000:0.0:1788873826.956372:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 253 00000100:00100000:0.0:1788873826.956380:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840137216:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873826.956438:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840137216:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 58us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.956459:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 253 00000100:00100000:0.0:1788873826.956477:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 254 00000100:00100000:0.0:1788873826.956483:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840137728:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873826.956510:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840137728:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.956527:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 254 00000100:00080000:1.0:1788873826.957339:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873826.957354:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873826.966276:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873826.976717:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137344 00000100:00100000:0.0:1788873826.976735:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137344 00000100:00100000:0.0:1788873826.976825:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137600 00000100:00100000:0.0:1788873826.976829:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137600 00000100:00100000:0.0:1788873826.976881:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 255 00000100:00100000:0.0:1788873826.976892:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840137344:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873826.977001:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840137344:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 110us (21985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.977009:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 255 00000100:00100000:0.0:1788873826.977029:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 256 00000100:00100000:0.0:1788873826.977036:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840137600:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873826.977061:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840137600:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (10798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873826.977067:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 256 00000100:00080000:1.0:1788873826.978125:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873826.978132:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788873827.438721:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788873828.015459:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788873828.016802:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788873828.464593:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873829.103654:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859105152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873829.103767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873829.104302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105152 00000100:00100000:2.0:1788873829.104312:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105152 00000100:00100000:2.0:1788873829.104367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788873829.104379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859105152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873829.104434:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788873829.104515:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859105152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873829.104522:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788873829.104632:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859105152:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788873829.490713:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873830.510507:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873830.638578:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859105280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873830.638702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873830.639511:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873830.639526:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859105408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873830.639596:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873830.647373:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105280 00000100:00100000:1.0:1788873830.647400:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105280 00000100:00100000:1.0:1788873830.647574:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105408 00000100:00100000:1.0:1788873830.647578:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105408 00000100:00100000:3.0:1788873830.647792:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788873830.647868:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873830.647907:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788873830.648778:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859105280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873830.648833:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873830.648975:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859105280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1152us (10273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873830.648984:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1788873830.651921:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a37b80 x1875769859105280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873830.651964:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859105280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873830.656990:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859105408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788873830.657047:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873830.657193:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859105408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9276us (17594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873830.657222:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788873830.660738:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b59500 x1875769859105408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873830.660775:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859105408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873831.151977:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859105664:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.152094:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873831.152168:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859106176:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.152195:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873831.152276:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859106688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.152300:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873831.152328:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788873831.152347:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859105792:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.152379:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873831.152397:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859106304:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.152420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873831.152437:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859106816:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.152457:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873831.152512:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105664 00000100:00100000:2.0:1788873831.152522:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105664 00000100:00100000:2.0:1788873831.152572:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106176 00000100:00100000:2.0:1788873831.152576:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106176 00000100:00100000:1.0:1788873831.152773:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859105536:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.152817:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.152848:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859106048:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.152874:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.152891:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859106560:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.152915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.152931:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859107072:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.152950:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.152968:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788873831.152974:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859105920:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.152997:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.153008:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859106432:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.153029:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.153060:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859106944:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.153099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.153130:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105536 00000100:00100000:1.0:1788873831.153134:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105536 00000100:00100000:1.0:1788873831.153170:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788873831.153178:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859105536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.153256:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859105536:12345-0@lo:400:kworker.0 Request processed in 78us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.153264:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788873831.153303:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106560 00000100:00100000:1.0:1788873831.153306:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106560 00000100:00100000:1.0:1788873831.153325:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107072 00000100:00100000:1.0:1788873831.153327:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107072 00000100:00100000:1.0:1788873831.153350:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106432 00000100:00100000:1.0:1788873831.153353:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106432 00000100:00100000:1.0:1788873831.153366:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106944 00000100:00100000:1.0:1788873831.153368:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106944 00000100:00100000:1.0:1788873831.153382:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788873831.153388:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859106560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.153422:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859106560:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.153429:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788873831.153441:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788873831.153446:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859107072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.153558:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859107072:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.153565:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788873831.153577:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788873831.154012:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105792 00000100:00100000:3.0:1788873831.154020:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105792 00000100:00100000:1.0:1788873831.154064:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859106432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.154120:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859106432:12345-0@lo:400:kworker.0 Request processed in 58us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.154127:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788873831.154141:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788873831.154148:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859106944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.154174:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859106944:12345-0@lo:400:kworker.0 Request processed in 27us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.154179:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788873831.154228:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788873831.154268:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abfb80 x1875769859106432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873831.154287:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859106432:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.154299:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859106944:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.154308:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859105536:0@lo:400:kworker.0 00010000:00080000:1.0:1788873831.154318:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abf100 x1875769859106560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873831.154326:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859106560:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.154335:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859107072:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.154411:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106688 00000100:00100000:1.0:1788873831.154416:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106688 00000100:00100000:2.0:1788873831.154533:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106304 00000100:00100000:2.0:1788873831.154538:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106304 00000100:00100000:2.0:1788873831.154557:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106816 00000100:00100000:2.0:1788873831.154560:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106816 00000100:00100000:2.0:1788873831.154572:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859105920 00000100:00100000:2.0:1788873831.154575:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859105920 00000100:00100000:0.0:1788873831.154731:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788873831.163660:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859106048 00000100:00100000:3.0:1788873831.163682:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859106048 00000100:00100000:3.0:1788873831.163715:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788873831.163728:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859105792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.163892:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859105792:12345-0@lo:400:kworker.0 Request processed in 166us (11511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.163901:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788873831.163923:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788873831.163931:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859106048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.163979:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859106048:12345-0@lo:400:kworker.0 Request processed in 49us (11103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.163986:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788873831.164064:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859105792:0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.164130:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859106048:0@lo:400:kworker.0 00000100:00080000:3.0:1788873831.164172:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873831.164179:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873831.164196:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788873831.164234:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859106176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.164281:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859106176:12345-0@lo:400:kworker.0 Request processed in 77us (12085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.164306:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788873831.164334:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788873831.164342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859106304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.164377:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859106304:12345-0@lo:400:kworker.0 Request processed in 36us (11956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.164383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788873831.164396:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788873831.164403:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859106816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.164436:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859106816:12345-0@lo:400:kworker.0 Request processed in 33us (11977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.164442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:3.0:1788873831.164488:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343a0bb80 x1875769859106304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873831.164503:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859106304:0@lo:400:kworker.0 00010000:00080000:3.0:1788873831.164518:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abd500 x1875769859106816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873831.164528:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859106816:0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.165683:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788873831.165698:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859106688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873831.165800:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859106688:12345-0@lo:400:kworker.0 Request processed in 107us (13498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.165808:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1788873831.165846:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873831.166452:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859106176:0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.166470:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859106688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.174219:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788873831.174241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859105920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873831.174391:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859105920:12345-0@lo:400:kworker.0 Request processed in 156us (21391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873831.174400:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788873831.174497:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859105664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873831.174553:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859105664:12345-0@lo:400:kworker.0 Request processed in 19814us (22459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873831.174561:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788873831.174725:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859105664:0@lo:400:kworker.0 00000100:00100000:3.0:1788873831.174775:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859105920:0@lo:400:kworker.0 00010000:00010000:0.0:1788873831.534595:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873831.664248:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859107328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873831.664361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873831.664463:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873831.664481:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859107200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873831.664516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873831.664920:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107328 00000100:00100000:3.0:1788873831.664949:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107328 00000100:00100000:3.0:1788873831.665021:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788873831.665032:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859107328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873831.665073:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873831.665149:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859107328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.665156:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788873831.665184:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107200 00000100:00100000:3.0:1788873831.665187:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107200 00000100:00100000:3.0:1788873831.665238:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788873831.665245:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859107200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873831.665272:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873831.665304:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859107200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873831.665310:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788873831.665987:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859107200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873831.666005:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859107328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873831.666080:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859107456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873831.666126:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873831.666227:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107456 00000100:00100000:1.0:1788873831.666232:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107456 00000100:00100000:1.0:1788873831.666276:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788873831.666283:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859107456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873831.666301:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873831.666484:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859107456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873831.666492:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788873831.668965:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859107456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873832.081303:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873832.081365:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873832.081397:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873832.081569:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138112 00000100:00100000:2.0:1788873832.081585:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138112 00000100:00100000:2.0:1788873832.081665:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137984 00000100:00100000:2.0:1788873832.081667:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137984 00000100:00100000:2.0:1788873832.081697:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 263 00000100:00100000:2.0:1788873832.081709:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840138112:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873832.081834:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840138112:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 128us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873832.081843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 263 00000100:00100000:2.0:1788873832.081874:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 264 00000100:00100000:2.0:1788873832.081881:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840137984:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873832.081904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840137984:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873832.081909:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 264 00000100:00080000:0.0:1788873832.082092:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873832.082098:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873832.082885:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840137856 00000100:00100000:3.0:1788873832.082897:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840137856 00000100:00100000:3.0:1788873832.082960:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 373 00000100:00100000:3.0:1788873832.082969:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840137856:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873832.083028:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840137856:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 60us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873832.083037:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 373 00000100:00100000:1.0:1788873832.086348:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873832.086421:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873832.086480:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873832.086606:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138368 00000100:00100000:0.0:1788873832.086619:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138368 00000100:00100000:0.0:1788873832.086709:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138496 00000100:00100000:0.0:1788873832.086713:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138496 00000100:00080000:1.0:1788873832.086904:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873832.086909:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873832.086958:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 265 00000100:00100000:0.0:1788873832.086972:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3342b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840138368:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873832.086993:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138240 00000100:00100000:2.0:1788873832.087001:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138240 00000100:00100000:2.0:1788873832.087051:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:2.0:1788873832.087061:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2397:x1875769840138240:12345-192.168.202.20@tcp:9:kworker.0 00000100:00100000:3.0:1788873832.087127:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 266 00000100:00100000:3.0:1788873832.087139:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840138496:12345-192.168.202.20@tcp:400:kworker.0 00000020:00000080:2.0:1788873832.087202:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b806 00000100:00080000:2.0:1788873832.087239:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d334400a000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788873832.091021:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873832.091200:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3342b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840138368:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 4217us (4763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873832.091228:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 265 00010000:00010000:1.0:1788873832.091996:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788873832.092003:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788873832.092091:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840138496:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 4949us (5620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873832.092104:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 266 00000100:00100000:2.0:1788873832.095044:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+2:2397:x1875769840138240:12345-192.168.202.20@tcp:9:kworker.0 Request processed in 7967us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873832.095064:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 27 00010000:00010000:0.0:1788873832.558352:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873833.589238:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873834.223737:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873834.223770:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859107584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873834.223868:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873834.224114:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107584 00000100:00100000:1.0:1788873834.224131:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107584 00000100:00100000:1.0:1788873834.224238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788873834.224250:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859107584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873834.224289:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788873834.224399:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859107584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873834.224406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788873834.224541:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859107584:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788873834.607437:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873835.632370:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873835.759029:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873835.759061:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859107712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873835.759177:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873835.759566:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859107840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873835.759597:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873835.759678:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107712 00000100:00100000:2.0:1788873835.759687:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107712 00000100:00100000:2.0:1788873835.759759:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107840 00000100:00100000:2.0:1788873835.759762:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107840 00000100:00100000:2.0:1788873835.759782:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788873835.759792:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859107712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873835.759828:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873835.759881:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859107712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873835.759911:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788873835.759940:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788873835.759946:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859107840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788873835.759955:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873835.759977:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859107840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873835.759982:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788873835.760028:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427e8380 x1875769859107840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873835.760050:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859107840:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788873835.760065:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f357100 x1875769859107712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873835.760077:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859107712:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788873835.760158:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873836.272518:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859108224:0@lo:400:kworker.0 00000100:00100000:1.0:1788873836.272626:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859108096:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.272638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873836.272745:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859107968:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.272827:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859108736:0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.273327:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859108352:0@lo:400:kworker.0 00000100:00100000:1.0:1788873836.276231:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873836.276326:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859108608:0@lo:400:kworker.0 00000100:00100000:1.0:1788873836.276381:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873836.276417:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859109120:0@lo:400:kworker.0 00000100:00100000:1.0:1788873836.276474:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873836.276547:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108096 00000100:00100000:1.0:1788873836.276559:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108096 00000100:00100000:2.0:1788873836.276784:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873836.276824:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859108480:0@lo:400:kworker.0 00000100:00100000:2.0:1788873836.276891:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873836.276905:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873836.276926:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859108992:0@lo:400:kworker.0 00000100:00100000:2.0:1788873836.276957:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873836.276988:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859109504:0@lo:400:kworker.0 00000100:00100000:2.0:1788873836.277012:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873836.277052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108224 00000100:00100000:2.0:1788873836.277059:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108224 00000100:00100000:3.0:1788873836.277131:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859109248:0@lo:400:kworker.0 00000100:00100000:2.0:1788873836.277141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108480 00000100:00100000:2.0:1788873836.277146:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108480 00000100:00100000:2.0:1788873836.277173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788873836.277186:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859108224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.277199:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873836.277301:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108608 00000100:00100000:1.0:1788873836.277465:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108608 00000100:00100000:1.0:1788873836.277499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109120 00000100:00100000:1.0:1788873836.277503:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109120 00000100:00100000:1.0:1788873836.277517:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108736 00000100:00100000:1.0:1788873836.277521:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108736 00000100:00100000:1.0:1788873836.277535:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109248 00000100:00100000:1.0:1788873836.277538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109248 00000100:00100000:1.0:1788873836.277554:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788873836.277561:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859108096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.280340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873836.280397:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859108864:0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.280469:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873836.280507:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859109376:0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.280530:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873836.280613:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108992 00000100:00100000:0.0:1788873836.280624:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108992 00000100:00100000:0.0:1788873836.280676:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109504 00000100:00100000:0.0:1788873836.280680:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109504 00000100:00100000:0.0:1788873836.280716:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108864 00000100:00100000:0.0:1788873836.280720:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108864 00000100:00100000:0.0:1788873836.280808:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109376 00000100:00100000:0.0:1788873836.280812:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109376 00000100:00100000:0.0:1788873836.280841:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788873836.280890:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859108352 00000100:00100000:3.0:1788873836.280904:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859108352 00000100:00100000:0.0:1788873836.280947:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859108992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.281098:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788873836.281112:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859108608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.281170:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859108992:12345-0@lo:400:kworker.0 Request processed in 225us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.281180:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788873836.281234:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873836.281244:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859109504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.281284:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859109504:12345-0@lo:400:kworker.0 Request processed in 43us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.281291:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873836.281304:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788873836.281310:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.281346:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859108864:12345-0@lo:400:kworker.0 Request processed in 36us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.281352:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788873836.281363:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788873836.281370:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859109376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.281397:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859109376:12345-0@lo:400:kworker.0 Request processed in 27us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.281403:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1788873836.281471:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b2c380 x1875769859108992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873836.281491:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859108992:0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.281515:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859109504:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.281555:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859108608:12345-0@lo:400:kworker.0 Request processed in 443us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873836.281566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:0.0:1788873836.281572:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3451803100 x1875769859108864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873836.281599:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859108864:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.281600:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788873836.281624:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859109120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.281632:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859109376:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.281677:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859109120:12345-0@lo:400:kworker.0 Request processed in 58us (5200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873836.281684:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788873836.281961:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788873836.282045:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859108736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.282168:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788873836.282180:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859109248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.282196:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859108736:12345-0@lo:400:kworker.0 Request processed in 223us (5301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.282245:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788873836.282272:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788873836.282284:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859108352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.282293:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859109248:12345-0@lo:400:kworker.0 Request processed in 112us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873836.282323:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788873836.282350:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859108352:12345-0@lo:400:kworker.0 Request processed in 68us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.282362:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788873836.282370:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788873836.282384:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859108480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.282412:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859108352:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.282470:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859108480:12345-0@lo:400:kworker.0 Request processed in 88us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873836.282478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788873836.282542:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859108480:0@lo:400:kworker.0 00010000:00080000:3.0:1788873836.282597:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343b2d880 x1875769859109248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873836.282610:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859109248:0@lo:400:kworker.0 00010000:00080000:3.0:1788873836.282623:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3451802d80 x1875769859108736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873836.282630:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859108736:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.282659:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859108608:0@lo:400:kworker.0 00000100:00100000:3.0:1788873836.282670:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859109120:0@lo:400:kworker.0 00000100:00100000:2.0:1788873836.284263:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859108224:12345-0@lo:400:kworker.0 Request processed in 7070us (11624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873836.284280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788873836.284371:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859108224:0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.284632:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859107968 00000100:00100000:0.0:1788873836.284643:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859107968 00000100:00100000:0.0:1788873836.284833:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788873836.284846:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859107968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873836.285183:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859107968:12345-0@lo:400:kworker.0 Request processed in 340us (8398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873836.285192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788873836.285343:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859107968:0@lo:400:kworker.0 00000100:00080000:3.0:1788873836.286778:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873836.286790:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873836.286793:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873836.289618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859108096:12345-0@lo:400:kworker.0 Request processed in 12040us (13404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873836.289638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788873836.289927:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859108096:0@lo:400:kworker.0 00010000:00010000:1.0:1788873836.654437:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873836.782399:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873836.782445:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859109632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873836.782563:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873836.782670:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109632 00000100:00100000:1.0:1788873836.782680:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109632 00000100:00100000:1.0:1788873836.782818:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788873836.782831:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859109632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873836.782885:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873836.783062:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859109760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873836.783101:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873836.783156:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109760 00000100:00100000:3.0:1788873836.783172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109760 00000100:00100000:3.0:1788873836.783232:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788873836.783240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859109760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873836.783269:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873836.783312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859109760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873836.783320:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788873836.783374:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859109760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873836.783504:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859109632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 674us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873836.783512:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788873836.784016:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859109888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873836.784052:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873836.784128:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859109632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873836.784239:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859109888 00000100:00100000:2.0:1788873836.784245:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859109888 00000100:00100000:2.0:1788873836.784282:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788873836.784291:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859109888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873836.784308:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873836.784355:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859109888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873836.784362:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788873836.784486:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859109888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873837.199155:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873837.199281:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873837.199305:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873837.200473:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873837.200859:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873837.200914:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138752 00000100:00100000:3.0:1788873837.200927:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138752 00000100:00100000:0.0:1788873837.201080:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138624 00000100:00100000:0.0:1788873837.201086:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138624 00000100:00100000:0.0:1788873837.201131:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 375 00000100:00100000:0.0:1788873837.201143:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840138624:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873837.201264:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840138624:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 123us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873837.201272:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 375 00000100:00100000:3.0:1788873837.201862:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139008 00000100:00100000:3.0:1788873837.201870:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139008 00000100:00100000:0.0:1788873837.203306:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840138880 00000100:00100000:0.0:1788873837.203319:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840138880 00000100:00100000:0.0:1788873837.203371:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139136 00000100:00100000:0.0:1788873837.203374:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139136 00000100:00100000:0.0:1788873837.203405:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 273 00000100:00100000:0.0:1788873837.203427:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840138752:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873837.203522:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840138752:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 107us (4239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873837.203530:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 273 00000100:00100000:0.0:1788873837.203550:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 274 00000100:00100000:0.0:1788873837.203558:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840139008:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873837.203584:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840139008:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873837.203591:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 274 00000100:00100000:0.0:1788873837.203603:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 275 00000100:00100000:0.0:1788873837.203609:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840138880:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873837.203634:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840138880:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873837.203641:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 275 00000100:00100000:0.0:1788873837.203657:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 276 00000100:00100000:0.0:1788873837.203664:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840139136:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873837.203709:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840139136:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 45us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873837.203715:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 276 00000100:00080000:2.0:1788873837.208193:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873837.208218:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788873837.678496:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788873837.811506:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:0.0:1788873837.811516:0:9507:0:(genops.c:885:class_export_put()) final put ffff9d334400f000/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:2.0:1788873837.811582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334400f000/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-OST0001 00000020:00000080:2.0:1788873837.811658:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d334400a000 for lustre-OST0001 00000040:00080000:2.0:1788873838.254811:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788873838.255742:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788873838.705059:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873839.343263:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859110016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873839.343377:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873839.343438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110016 00000100:00100000:3.0:1788873839.343451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110016 00000100:00100000:3.0:1788873839.343521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788873839.343536:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859110016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873839.343584:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788873839.343692:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859110016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873839.343701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788873839.344415:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859110016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788873839.738686:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873840.752281:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873840.879180:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859110144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873840.879322:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873840.880796:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873840.880821:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859110272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873840.880896:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873840.901783:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110144 00000100:00100000:1.0:1788873840.901806:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110144 00000100:00080000:2.0:1788873840.901929:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873840.903057:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110272 00000100:00100000:0.0:1788873840.903068:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110272 00000100:00100000:0.0:1788873840.903267:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788873840.903292:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859110144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788873840.903341:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873840.903474:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859110144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (24151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873840.903482:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788873840.903501:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788873840.903508:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859110272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873840.903520:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873840.903555:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859110272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (22659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873840.903586:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1788873840.903655:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a7480 x1875769859110272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873840.903688:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859110272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788873840.904390:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788873840.904456:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42b800 x1875769859110144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873840.904476:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859110144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873841.399569:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859110400:0@lo:400:kworker.0 00000100:00100000:3.0:1788873841.399691:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873841.400033:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110400 00000100:00100000:2.0:1788873841.400044:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110400 00000100:00100000:2.0:1788873841.400113:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788873841.400124:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859110400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.401984:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859110528:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402082:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.402124:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859111040:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402148:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.402166:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859111552:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402188:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.402234:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788873841.402241:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859110656:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402271:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.402304:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859111168:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402327:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.402342:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859111680:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402361:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.402409:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110528 00000100:00100000:1.0:1788873841.402420:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110528 00000100:00100000:1.0:1788873841.402492:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111040 00000100:00100000:1.0:1788873841.402496:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111040 00000100:00100000:1.0:1788873841.402524:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111552 00000100:00100000:1.0:1788873841.402527:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111552 00000100:00100000:1.0:1788873841.402539:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111168 00000100:00100000:1.0:1788873841.402541:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111168 00000100:00100000:1.0:1788873841.402553:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111680 00000100:00100000:1.0:1788873841.402556:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111680 00000100:00100000:1.0:1788873841.402572:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788873841.402583:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859110528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402644:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859110528:12345-0@lo:400:kworker.0 Request processed in 63us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873841.402651:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788873841.402670:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788873841.402675:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859111040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402701:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859111040:12345-0@lo:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873841.402707:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788873841.402719:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788873841.402725:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859111552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402749:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859111552:12345-0@lo:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873841.402765:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788873841.402777:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788873841.402782:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859111168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402809:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859111168:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873841.402814:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788873841.402824:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788873841.402829:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859111680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402854:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859111680:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873841.402860:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1788873841.402891:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873841.402896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788873841.402932:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334401ad80 x1875769859111168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873841.402950:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859111168:0@lo:400:kworker.0 00010000:00080000:1.0:1788873841.402962:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a0a80 x1875769859111680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873841.402970:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859111680:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402981:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859110528:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.402991:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859111040:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403000:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859111552:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403058:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110656 00000100:00100000:1.0:1788873841.403068:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110656 00000100:00100000:1.0:1788873841.403100:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788873841.403106:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859110656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403145:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859110656:12345-0@lo:400:kworker.0 Request processed in 39us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873841.403151:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788873841.403169:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859110784:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403199:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.403241:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859111296:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403268:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.403286:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859111808:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403306:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873841.403327:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788873841.403333:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859110912:0@lo:400:kworker.0 00000100:00100000:1.0:1788873841.403357:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873841.404637:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859110656:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.404683:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110912 00000100:00100000:0.0:1788873841.404690:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110912 00000100:00100000:0.0:1788873841.404745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788873841.404754:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859110912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.404850:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859110912:12345-0@lo:400:kworker.0 Request processed in 97us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873841.404857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788873841.404897:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859110784 00000100:00100000:0.0:1788873841.404902:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859110784 00000100:00100000:0.0:1788873841.404932:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788873841.404938:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859110784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.404971:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859110784:12345-0@lo:400:kworker.0 Request processed in 33us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873841.404977:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788873841.405009:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111296 00000100:00100000:0.0:1788873841.405015:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111296 00000100:00100000:0.0:1788873841.405049:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111808 00000100:00100000:0.0:1788873841.405053:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111808 00000100:00100000:0.0:1788873841.405086:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788873841.405094:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859111296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.405142:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859111296:12345-0@lo:400:kworker.0 Request processed in 50us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873841.405149:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788873841.405162:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788873841.405168:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859111808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.405194:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859111808:12345-0@lo:400:kworker.0 Request processed in 28us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873841.405199:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788873841.405260:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873841.406480:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.406989:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873841.407035:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859111936:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407133:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873841.407179:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859110784:0@lo:400:kworker.0 00010000:00080000:0.0:1788873841.407196:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344019180 x1875769859111296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873841.407229:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859111296:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407243:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859111808:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407275:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859110912:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407474:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111424 00000100:00100000:0.0:1788873841.407483:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111424 00000100:00100000:0.0:1788873841.407535:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859111936 00000100:00100000:0.0:1788873841.407538:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859111936 00000100:00100000:0.0:1788873841.407564:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873841.407572:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859111424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407645:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859111424:12345-0@lo:400:kworker.0 Request processed in 74us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873841.407653:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788873841.407669:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788873841.407675:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859111936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407696:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859111936:12345-0@lo:400:kworker.0 Request processed in 22us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873841.407702:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788873841.407720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788873841.407741:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a2300 x1875769859111424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873841.407751:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788873841.407760:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859111936:0@lo:400:kworker.0 00000100:00100000:2.0:1788873841.412676:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859110400:12345-0@lo:400:kworker.0 Request processed in 12524us (12956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873841.412700:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788873841.415583:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859110400:0@lo:400:kworker.0 00010000:00010000:1.0:1788873841.774544:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873841.902464:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859112064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873841.902584:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873841.902679:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873841.902686:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859112192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873841.902715:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873841.902752:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859112320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873841.902784:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873841.902831:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859112064 00000100:00100000:3.0:1788873841.902840:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859112064 00000100:00100000:3.0:1788873841.902909:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859112192 00000100:00100000:3.0:1788873841.902913:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859112192 00000100:00100000:3.0:1788873841.902933:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788873841.902943:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859112064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873841.902982:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873841.903036:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859112064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873841.903043:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788873841.903072:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788873841.903090:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859112192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873841.903101:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873841.903126:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859112192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873841.903131:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788873841.903167:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859112320 00000100:00100000:3.0:1788873841.903172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859112320 00000100:00100000:3.0:1788873841.903201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788873841.903240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859112320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873841.903269:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873841.903306:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859112320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873841.903313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788873841.903382:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859112320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873841.903428:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859112192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873841.903442:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859112064:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788873842.063873:0:14058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:24:01 (1788873841) 00000100:00100000:3.0:1788873842.315386:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873842.315694:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139264 00000100:00100000:0.0:1788873842.315710:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139264 00000100:00100000:0.0:1788873842.315792:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 377 00000100:00100000:0.0:1788873842.315805:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840139264:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873842.315903:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840139264:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 101us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873842.315912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 377 00000100:00100000:0.0:1788873842.316967:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873842.317072:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873842.320873:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873842.321181:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139520 00000100:00100000:1.0:1788873842.321196:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139520 00000100:00100000:1.0:1788873842.321317:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139776 00000100:00100000:1.0:1788873842.321322:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139776 00000100:00100000:1.0:1788873842.321353:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 283 00000100:00100000:1.0:1788873842.321376:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840139520:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873842.321485:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840139520:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 122us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873842.321495:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 283 00000100:00100000:1.0:1788873842.321538:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 284 00000100:00100000:1.0:1788873842.321545:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840139776:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873842.321574:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840139776:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 30us (4503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873842.321580:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 284 00000100:00080000:3.0:1788873842.322386:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873842.322819:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873842.323168:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139392 00000100:00100000:3.0:1788873842.323179:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139392 00000100:00080000:0.0:1788873842.323395:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873842.323504:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139648 00000100:00100000:3.0:1788873842.323508:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139648 00000100:00100000:3.0:1788873842.323543:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 285 00000100:00100000:3.0:1788873842.323554:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840139392:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873842.323636:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840139392:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 84us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873842.323651:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 285 00000100:00100000:3.0:1788873842.323669:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 286 00000100:00100000:3.0:1788873842.323676:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840139648:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873842.323706:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840139648:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873842.323713:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 286 00000100:00080000:1.0:1788873842.324454:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788873842.798605:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873843.526920:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873843.527274:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840139904 00000100:00100000:3.0:1788873843.527289:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840139904 00000100:00100000:3.0:1788873843.527450:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:3.0:1788873843.527464:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:11082:x1875769840139904:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873843.527503:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873843.527537:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b8e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873843.527624:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9b8ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873843.527641:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9b8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873843.527659:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9b8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873843.528627:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788873843.528632:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873843.529228:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9b8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873843.529298:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b8e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95e2 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873843.529743:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9b8ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95e2 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873843.529752:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc2900) 00010000:00010000:3.0:1788873843.529755:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873843.529758:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873843.531607:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:11082:x1875769840139904:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 4131us (4686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873843.531621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:3.0:1788873843.544768:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873843.546020:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840140032 00000100:00100000:1.0:1788873843.546043:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840140032 00000100:00100000:1.0:1788873843.546160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:1.0:1788873843.546174:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:11083:x1875769840140032:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788873843.546262:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873843.546297:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b8f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95e9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546406:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546424:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546439:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546458:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546467:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546509:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546611:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9b909 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546620:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9b909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546629:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9b909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873843.546703:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788873843.546708:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873843.546739:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9b909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546753:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546761:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546770:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546776:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873843.546782:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546791:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546825:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc2900) 00010000:00010000:1.0:1788873843.546830:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873843.546837:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.546844:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b8fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.548657:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.548742:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.548751:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.548759:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873843.548764:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.548774:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.548797:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d33410dd600) 00010000:00010000:1.0:1788873843.548801:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873843.548807:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.549609:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.549806:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b8f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95e9 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.549954:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9b909 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95e9 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873843.549965:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d33410dda00) 00010000:00010000:1.0:1788873843.549968:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873843.549972:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb800, rc 0) 00000100:00100000:1.0:1788873843.550184:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11083:x1875769840140032:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 4011us (5430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873843.550195:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:2.0:1788873843.558182:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873843.558531:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840140160 00000100:00100000:0.0:1788873843.558546:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840140160 00000100:00100000:0.0:1788873843.558614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:0.0:1788873843.558623:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11083:x1875769840140160:12345-192.168.202.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788873843.559009:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11083:x1875769840140160:12345-192.168.202.20@tcp:900:lhsmtool_posix.0 Request processed in 386us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873843.559016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:3.0:1788873843.562562:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873843.563566:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840140416 00000100:00100000:2.0:1788873843.563580:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840140416 00000100:00100000:2.0:1788873843.563700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:2.0:1788873843.563710:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11083:x1875769840140416:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873843.563733:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873843.563758:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b910 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.563857:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.563872:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.563884:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.574661:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.574693:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.574707:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.575928:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b925 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.575953:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.575966:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873843.575985:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788873843.576120:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576128:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576135:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576140:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873843.576145:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576192:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576228:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d33410dda00) 00010000:00010000:2.0:1788873843.576231:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873843.576237:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576243:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9b917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576257:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576263:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576269:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576273:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873843.576275:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576282:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576289:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3460230e00) 00010000:00010000:2.0:1788873843.576291:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873843.576294:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576308:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b91e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576629:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b910 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95f0 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576646:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b925 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95f0 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873843.576654:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:2.0:1788873843.576656:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873843.576658:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e200, rc 0) 00000100:00100000:2.0:1788873843.576740:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:11083:x1875769840140416:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 13030us (14196us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788873843.576750:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:2.0:1788873843.580795:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873843.580990:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840140544 00000100:00100000:0.0:1788873843.581009:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840140544 00000100:00100000:0.0:1788873843.581105:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:0.0:1788873843.581116:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:11083:x1875769840140544:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788873843.581302:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:11083:x1875769840140544:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 Request processed in 187us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873843.581311:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:0.0:1788873843.585501:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873843.586309:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840140672 00000100:00100000:1.0:1788873843.586326:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840140672 00000100:00100000:1.0:1788873843.586415:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:1.0:1788873843.586429:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:11083:x1875769840140672:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788873843.590530:0:6511:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3912us 00000100:00100000:3.0:1788873843.621758:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:11083:x1875769840140672:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 Request processed in 35318us (36260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873843.621779:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 44 00010000:00010000:0.0:1788873843.822742:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873844.401757:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788873844.403972:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788873844.463815:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859112448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873844.463927:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873844.464034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859112448 00000100:00100000:0.0:1788873844.464045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859112448 00000100:00100000:0.0:1788873844.464110:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788873844.464121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859112448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873844.464165:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788873844.467407:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859112448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3274us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873844.467427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788873844.468438:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859112448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788873844.851038:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873845.860857:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873845.860951:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840140800 00000100:00100000:3.0:1788873845.860967:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840140800 00000100:00100000:3.0:1788873845.861062:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:3.0:1788873845.861076:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:11125:x1875769840140800:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873845.861113:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873845.861143:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95f7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788873845.861429:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788873845.861477:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861498:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861517:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861537:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861545:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861552:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861677:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861685:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861693:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873845.861714:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861723:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861739:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc2900) 00010000:00010000:3.0:1788873845.861743:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873845.861749:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861756:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9b93a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861768:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861775:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861780:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861785:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873845.861788:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861793:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861800:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d3476dc2200) 00010000:00010000:3.0:1788873845.861802:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873845.861811:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861818:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9b941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861861:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b933 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95f7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861873:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc2900) 00010000:00010000:3.0:1788873845.861876:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873845.861880:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95f7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873845.861889:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873845.862394:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:11125:x1875769840140800:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1317us (1548us total) trans 0 rc 301/301 00000100:00100000:3.0:1788873845.862404:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 45 00010000:00010000:0.0:1788873845.872114:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873845.872241:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873845.872561:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141056 00000100:00100000:1.0:1788873845.872575:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141056 00000100:00100000:1.0:1788873845.872650:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:1.0:1788873845.872662:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+9:11125:x1875769840141056:12345-192.168.202.20@tcp:36:lfs.0 00010000:00010000:1.0:1788873845.872743:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873845.872782:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9b8ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95e2 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.872821:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc2900) 00010000:00010000:1.0:1788873845.872835:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873845.872927:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.872942:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.872953:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.872969:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.872976:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.872982:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873843:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873859:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873868:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873845.873885:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca16dd51 reply state 00000000a038f79f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873913:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873920:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:1.0:1788873845.873922:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873845.873926:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788873845.873932:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788873845.873940:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873947:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873954:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873961:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecac00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873845.873966:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873975:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873984:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd600) 00010000:00010000:1.0:1788873845.873987:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873845.873991:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.873998:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b948 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873845.874026:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca16dd51 reply state 00000000a038f79f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.874038:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873845.874044:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d33410dd900) 00010000:00010000:1.0:1788873845.874046:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873845.874048:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788873845.874232:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+10:11125:x1875769840141056:12345-192.168.202.20@tcp:36:lfs.0 Request processed in 1540us (1967us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788873845.874242:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:3.0:1788873845.943738:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873845.946643:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141184 00000100:00100000:0.0:1788873845.946666:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141184 00000100:00100000:0.0:1788873845.946765:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:0.0:1788873845.946777:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:11133:x1875769840141184:12345-192.168.202.20@tcp:101:lctl.0 00010000:00010000:0.0:1788873845.946809:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873845.946841:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b95d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a95fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873845.946936:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873845.946955:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873845.946969:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873845.947033:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788873845.947038:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873845.947087:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873845.947116:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b95d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95fe expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873845.947136:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95fe expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873845.947162:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:0.0:1788873845.947166:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788873845.947171:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93200, rc 0) 00000100:00100000:0.0:1788873845.947378:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:11133:x1875769840141184:12345-192.168.202.20@tcp:101:lctl.0 Request processed in 602us (3655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873845.947386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:3.0:1788873846.000637:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859112576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873846.000741:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873846.000862:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859112576 00000100:00100000:3.0:1788873846.000871:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859112576 00000100:00100000:3.0:1788873846.000934:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788873846.000944:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859112576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873846.000983:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873846.001030:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859112576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.001049:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788873846.001074:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788873846.001108:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abd500 x1875769859112576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873846.001130:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859112576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873846.001435:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873846.001445:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873846.001477:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873846.001513:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859112704 00000100:00100000:0.0:1788873846.001516:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859112704 00000100:00100000:0.0:1788873846.001549:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788873846.001555:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859112704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788873846.001566:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873846.001612:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859112704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.001619:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788873846.001634:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788873846.001652:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343abce00 x1875769859112704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873846.001665:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873846.011632:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.017491:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141312 00000100:00100000:0.0:1788873846.017519:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141312 00000100:00100000:0.0:1788873846.017670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 48 00000100:00100000:0.0:1788873846.017684:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+11:11139:x1875769840141312:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873846.017742:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873846.017780:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b96b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9605 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.017893:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.017912:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.017927:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.017939:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.017946:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.017953:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018065:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93000/0x25c660afb0a9b980 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018073:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93000/0x25c660afb0a9b980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018080:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93000/0x25c660afb0a9b980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873846.018136:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788873846.018148:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873846.018245:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93000/0x25c660afb0a9b980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018261:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018269:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018277:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018282:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873846.018288:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018296:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018310:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:0.0:1788873846.018313:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873846.018319:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018325:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018350:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018357:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018375:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018380:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873846.018383:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018390:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018399:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d33410dd900) 00010000:00010000:0.0:1788873846.018401:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873846.018404:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018410:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018442:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9b96b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9605 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018456:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93000/0x25c660afb0a9b980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9605 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.018464:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873846.018466:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788873846.018469:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93000, rc 0) 00000100:00100000:0.0:1788873846.018586:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+12:11139:x1875769840141312:12345-192.168.202.20@tcp:101:bash.0 Request processed in 904us (6968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.018603:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 48 00000100:00100000:3.0:1788873846.020897:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873846.023200:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141568 00000100:00100000:1.0:1788873846.023247:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141568 00000100:00100000:1.0:1788873846.023353:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 49 00000100:00100000:1.0:1788873846.023368:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+12:11139:x1875769840141568:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:1.0:1788873846.023399:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873846.023432:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b987 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a960c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.023584:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.023603:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.023617:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.025991:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026021:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026038:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788873846.026502:0:8450:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788873846.026677:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026688:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026697:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026734:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026743:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026750:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026756:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873846.026761:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.026997:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.027011:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:1.0:1788873846.027015:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873846.027020:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.027026:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9b98e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873846.027041:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d46ae96 reply state 00000000e53cd9d4 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.027052:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.027059:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:1.0:1788873846.027061:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873846.027065:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788873846.027111:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9b987 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 15 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.027128:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 14 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.027135:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:1.0:1788873846.027137:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873846.027140:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb400, rc 0) 00000100:00100000:1.0:1788873846.027264:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11139:x1875769840141568:12345-192.168.202.20@tcp:101:bash.0 Request processed in 3899us (6381us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788873846.027280:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 49 00000100:00100000:3.0:1788873846.030143:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.030284:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141696 00000100:00100000:0.0:1788873846.030295:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141696 00000100:00100000:0.0:1788873846.030355:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 28 00000100:00100000:0.0:1788873846.030364:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875769840141696:12345-192.168.202.20@tcp:8:bash.0 00010000:00080000:0.0:1788873846.030404:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:0.0:1788873846.030441:0:8425:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9b9aa 00002000:00100000:0.0:1788873846.030454:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64e5d878-4280-4742-8a19-a12ccf17cae7/ffff9d334400f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788873846.030470:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788873846.030561:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788873846.032026:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d3344009800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873846.032123:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840141696:12345-192.168.202.20@tcp:8:bash.0 Request processed in 1753us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.032134:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 28 00000100:00100000:3.0:1788873846.036817:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.037013:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141824 00000100:00100000:0.0:1788873846.037024:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141824 00000100:00100000:0.0:1788873846.037455:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:0.0:1788873846.037467:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840141824:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873846.037488:0:8789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873846.037517:0:8789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9613 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788873846.037546:0:8789:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788873846.037566:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788873846.037571:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873846.037596:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 7 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.037619:0:8789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 7 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.037633:0:8789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92400, rc 0) 00000100:00100000:0.0:1788873846.037690:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:0:x1875769840141824:12345-192.168.202.20@tcp:101:bash.0 Request processed in 225us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.037697:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00080000:3.0:1788873846.038428:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873846.043710:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.043907:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840141952 00000100:00100000:2.0:1788873846.043920:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840141952 00000100:00100000:2.0:1788873846.043986:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:2.0:1788873846.043998:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11139:x1875769840141952:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873846.044017:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873846.044040:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a961a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.044073:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.044103:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873846.044107:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873846.044114:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.044164:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.044181:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873846.044200:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875769859112832:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873846.044366:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873846.048643:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875769859112832:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873846.048686:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.048708:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ec00, rc 0) 00000100:00100000:2.0:1788873846.048810:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:11139:x1875769840141952:12345-192.168.202.20@tcp:101:bash.0 Request processed in 4813us (5114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.048821:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:3.0:1788873846.053700:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.054838:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840142080 00000100:00100000:0.0:1788873846.054855:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840142080 00010000:00010000:0.0:1788873846.054924:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873846.054975:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:0.0:1788873846.054987:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458497850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840142080:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873846.055005:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873846.055029:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.055044:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.055071:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053413310/0x25c660afb0a9b9b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9613 expref: 8 pid: 8789 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.055114:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873846.055119:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873846.055129:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.055140:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.055181:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873846.055195:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1875769859112960:192.168.202.20@tcp:105: 00000100:00100000:0.0:1788873846.055346:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33429a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873846.060147:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.060306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840142336 00000100:00100000:2.0:1788873846.060316:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840142336 00000100:00100000:2.0:1788873846.060389:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:2.0:1788873846.060418:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11139:x1875769840142336:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:2.0:1788873846.060785:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11139:x1875769840142336:12345-192.168.202.20@tcp:35:bash.0 Request processed in 369us (649us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788873846.060795:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:0.0:1788873846.061260:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343abce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1875769859112960:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788873846.061285:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873846.061314:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458497850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840142080:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 6329us (7628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.061323:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:3.0:1788873846.138844:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.138970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840142592 00000100:00100000:2.0:1788873846.138986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840142592 00000100:00100000:2.0:1788873846.139072:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:2.0:1788873846.139082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11149:x1875769840142592:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873846.139107:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873846.139133:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b9bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9621 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873846.139294:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788873846.139419:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b9bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9621 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.139434:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:2.0:1788873846.139438:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873846.139444:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b9bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9621 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.139458:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ee00, rc 0) 00000100:00100000:2.0:1788873846.141026:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+17:11149:x1875769840142592:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1936us (2197us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788873846.141037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:1.0:1788873846.148928:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.149006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840142848 00000100:00100000:2.0:1788873846.149029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840142848 00000100:00100000:2.0:1788873846.149092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:2.0:1788873846.149103:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+17:11149:x1875769840142848:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873846.149366:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+18:11149:x1875769840142848:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 265us (447us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788873846.149374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:1.0:1788873846.223601:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.223716:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840142976 00000100:00100000:0.0:1788873846.223728:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840142976 00000100:00100000:0.0:1788873846.223827:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:0.0:1788873846.223840:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+18:11155:x1875769840142976:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873846.223872:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873846.223900:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b9cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9628 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.224400:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b9d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.224418:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.224433:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873846.224482:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788873846.224486:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873846.224512:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.224539:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9b9cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9628 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.224557:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9628 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.224567:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873846.224570:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788873846.224573:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92800, rc 0) 00000100:00100000:0.0:1788873846.224634:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11155:x1875769840142976:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 797us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.224641:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:0.0:1788873846.229064:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.229509:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840143232 00000100:00100000:2.0:1788873846.229527:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840143232 00000100:00100000:2.0:1788873846.229597:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:2.0:1788873846.229610:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11155:x1875769840143232:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873846.229636:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873846.229662:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b9db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a962f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.229784:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b9e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.229800:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.229811:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873846.229823:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788873846.229934:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9b9db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a962f expref: 22 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.229952:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a962f expref: 21 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.230945:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:2.0:1788873846.230949:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873846.230953:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873846.231093:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11155:x1875769840143232:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1484us (2044us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788873846.231102:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:1.0:1788873846.236317:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.236460:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840143488 00000100:00100000:3.0:1788873846.236473:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840143488 00000100:00100000:3.0:1788873846.236590:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:3.0:1788873846.236601:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11155:x1875769840143488:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873846.236627:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873846.236650:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b9f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9636 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.236767:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b9f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.236800:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b9f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.236836:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b9f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873846.236850:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788873846.236960:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9b9f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9636 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.236990:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b9f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9636 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.237000:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:3.0:1788873846.237003:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788873846.237007:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873846.237068:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+23:11155:x1875769840143488:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 468us (765us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788873846.237076:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:1.0:1788873846.238743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.241012:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840143616 00000100:00100000:2.0:1788873846.241028:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840143616 00000100:00100000:2.0:1788873846.241116:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:2.0:1788873846.241128:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+23:2398:x1875769840143616:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873846.241144:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873846.241168:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9b9e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a962f expref: 23 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.241188:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:2.0:1788873846.241194:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873846.241293:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2398:x1875769840143616:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 167us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.241301:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:0.0:1788873846.247509:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.247653:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840143744 00000100:00100000:3.0:1788873846.247671:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840143744 00000100:00100000:3.0:1788873846.247761:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:3.0:1788873846.247775:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840143744:12345-192.168.202.20@tcp:1:lfs.0 00010000:00010000:3.0:1788873846.247871:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.247901:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.247912:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788873846.247930:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873846.247938:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.247994:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.248320:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 7 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.248353:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875769859113088:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873846.248565:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873846.256072:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875769859113088:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873846.256122:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873846.256710:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.260395:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840143872 00000100:00100000:2.0:1788873846.260412:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840143872 00002000:00100000:2.0:1788873846.260467:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9d347f3a3800 x1875769840143872/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:262/0 lens 504/0 e 0 to 0 dl 1788873857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788873846.260477:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f3a3800 with x1875769840143872 ext(0->12) 00010000:00010000:2.0:1788873846.260487:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 8 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.260517:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 8 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873846.260647:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d347f3a3800 00000100:00100000:2.0:1788873846.260684:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:2.0:1788873846.260695:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840143872:12345-192.168.202.20@tcp:4:lfs.0 00000001:00100000:0.0:1788873846.268135:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000100:00100000:2.0:1788873846.271431:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840143872:12345-192.168.202.20@tcp:4:lfs.0 Request processed in 10725us (14717us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788873846.271447:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00002000:00100000:2.0:1788873846.271462:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9d347f3a3800 x1875769840143872/t4294967300(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:262/0 lens 504/448 e 0 to 0 dl 1788873857 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788873846.271474:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f3a3800 with x1875769840143872 ext(0->12) 00010000:00010000:2.0:1788873846.271486:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 9 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.271508:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 9 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873846.271515:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d347f3a3800 00000100:00100000:1.0:1788873846.276433:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.276961:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840144000 00000100:00100000:3.0:1788873846.276972:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840144000 00010000:00010000:3.0:1788873846.277011:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 9 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.277056:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:3.0:1788873846.277065:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840144000:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873846.277081:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788873846.277100:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788873846.277104:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788873846 00002000:00010000:3.0:1788873846.277294:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788873846 00002000:00010000:3.0:1788873846.277298:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788873846 00002000:00010000:3.0:1788873846.277300:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788873846.277308:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 9 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.277323:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 9 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.277363:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9b9b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a961a expref: 9 pid: 8427 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.277380:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873846.277385:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873846.277390:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.277400:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.277494:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873846.277573:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840144000:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 508us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.277592:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 53 00010000:00010000:2.0:1788873846.278023:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278034:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278067:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278075:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278083:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278090:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873846.278095:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278104:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278134:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.278141:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9ba05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873846.278499:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840143744:12345-192.168.202.20@tcp:1:lfs.0 Request processed in 30724us (30998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.278508:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:1.0:1788873846.286274:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.286449:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840144256 00000100:00100000:2.0:1788873846.286461:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840144256 00000100:00100000:2.0:1788873846.286516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:2.0:1788873846.286524:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+22:11155:x1875769840144256:12345-192.168.202.20@tcp:35:lfs.0 00000004:00010000:2.0:1788873846.286596:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b9f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9636 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788873846.286834:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788873846.286885:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788873846.287252:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788873846.287298:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.287314:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 26 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.287322:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.287369:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 26 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.287385:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 26 pid: 8450 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873846.287403:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875769859113216:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873846.289432:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873846.307387:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.307511:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875769859113216:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873846.307560:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.307637:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840144384 00000100:00100000:3.0:1788873846.307645:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840144384 00010000:00010000:3.0:1788873846.307682:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 27 pid: 8450 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.307734:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:3.0:1788873846.307744:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:2401:x1875769840144384:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873846.307758:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873846.307766:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 27 pid: 8450 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.307778:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 27 pid: 8450 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.307799:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9b99c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a960c expref: 27 pid: 8450 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.307813:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:3.0:1788873846.307818:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.307838:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.307846:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.307868:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873846.307909:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+26:2401:x1875769840144384:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 167us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.307916:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 54 00010000:00010000:2.0:1788873846.307966:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.307974:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788873846.308073:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788873846.308178:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788873846.308298:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859113344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788873846.308349:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.308371:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873846.308487:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859113344 00000100:00100000:3.0:1788873846.308498:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859113344 00000100:00100000:3.0:1788873846.308537:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788873846.308544:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875769859113344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788873846.308630:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875769859113344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.308637:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788873846.309062:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859113344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788873846.309285:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788873846.309340:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859113472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788873846.309373:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.309387:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873846.309592:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859113472 00000100:00100000:1.0:1788873846.309598:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859113472 00000100:00100000:1.0:1788873846.309636:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788873846.309644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875769859113472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788873846.309751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1875769859113472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (376us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788873846.309758:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788873846.310582:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859113472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788873846.310641:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788873846.310680:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.310691:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.310698:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.310720:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215f800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873846.310725:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.310735:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.310750:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:2.0:1788873846.310753:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788873846.310758:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.310765:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9ba0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873846.310962:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788873846.311032:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788873846.311044:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383256838473ns, next at 384256836059ns, rc = 0 00000001:00080000:2.0:1788873846.311051:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788873846.311072:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dde00) 00010000:00010000:2.0:1788873846.311075:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788873846.311082:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9b9f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9636 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873846.311188:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+29:11155:x1875769840144256:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 24664us (24926us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788873846.311197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 8 00000020:00080000:2.0:1788873846.311201:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788873846.313742:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.313813:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840144512 00000100:00100000:3.0:1788873846.313823:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840144512 00000100:00100000:3.0:1788873846.313959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:3.0:1788873846.313969:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+29:11155:x1875769840144512:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873846.313990:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873846.314011:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ba13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a963d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.314061:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ba13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a963d expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.314077:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ba13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a963d expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.314095:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873846.314098:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873846.314101:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443a00, rc 0) 00000100:00100000:3.0:1788873846.314162:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+30:11155:x1875769840144512:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 194us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.314170:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:1.0:1788873846.327123:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.327280:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840144768 00000100:00100000:3.0:1788873846.327301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840144768 00000100:00100000:3.0:1788873846.327380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:3.0:1788873846.327390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+30:11155:x1875769840144768:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873846.327596:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+31:11155:x1875769840144768:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 206us (481us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788873846.327604:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788873846.403097:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.403670:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840145024 00000100:00100000:2.0:1788873846.403687:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840145024 00000100:00100000:3.0:1788873846.404183:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:3.0:1788873846.404197:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+31:11165:x1875769840145024:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873846.404260:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873846.404289:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9644 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873846.404450:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788873846.404602:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9644 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.404622:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:3.0:1788873846.404625:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873846.404633:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9644 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.404651:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873846.404812:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+32:11165:x1875769840145024:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 617us (1805us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788873846.404830:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:0.0:1788873846.407119:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.407310:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840145152 00000100:00100000:3.0:1788873846.407348:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840145152 00000100:00100000:3.0:1788873846.407424:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:3.0:1788873846.407437:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+32:11165:x1875769840145152:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:3.0:1788873846.407550:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407575:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407589:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407602:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407610:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407617:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407726:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407735:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.407741:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873846.408120:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408151:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408158:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408165:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408171:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873846.408176:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408183:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408198:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:3.0:1788873846.408201:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873846.408229:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408298:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408319:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408325:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408341:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408354:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873846.408357:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408364:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408373:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:3.0:1788873846.408376:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873846.408379:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408385:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408395:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408401:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408407:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408412:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873846.408415:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408420:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408436:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873846.408439:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873846.408442:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.408448:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.408604:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+32:11165:x1875769840145152:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 1166us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.408613:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:2.0:1788873846.411030:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.411402:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840145408 00000100:00100000:3.0:1788873846.411418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840145408 00000100:00100000:2.0:1788873846.411588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:2.0:1788873846.411602:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+32:11165:x1875769840145408:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873846.412326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+33:11165:x1875769840145408:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 723us (1315us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788873846.412345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:1.0:1788873846.444290:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.444627:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840145664 00000100:00100000:3.0:1788873846.444641:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840145664 00000100:00100000:3.0:1788873846.444770:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:3.0:1788873846.444783:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+33:11168:x1875769840145664:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873846.445029:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873846.445061:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a964b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445164:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445184:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445199:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445287:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445296:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445303:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445466:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445476:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445485:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873846.445499:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788873846.445608:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445617:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445623:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445630:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873846.445635:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445654:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445669:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:3.0:1788873846.445672:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873846.445678:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445685:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9ba44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445703:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445709:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445715:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445719:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873846.445722:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445727:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445734:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:3.0:1788873846.445737:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873846.445740:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445756:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ba4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445839:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9ba3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 36 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445856:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.445865:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873846.445867:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873846.445870:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873846.445967:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11168:x1875769840145664:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1186us (1690us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788873846.445976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:2.0:1788873846.453642:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.453759:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840145792 00000100:00100000:3.0:1788873846.453775:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840145792 00000100:00100000:3.0:1788873846.453989:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:3.0:1788873846.454003:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11168:x1875769840145792:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:3.0:1788873846.454117:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454140:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454155:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454441:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454451:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454458:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454465:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873846.454470:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454480:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454497:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873846.454501:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873846.454507:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.454515:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ba60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.454688:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11168:x1875769840145792:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 687us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.454699:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:2.0:1788873846.457926:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.458115:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840146048 00000100:00100000:0.0:1788873846.458130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840146048 00000100:00100000:0.0:1788873846.458292:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:0.0:1788873846.458306:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11168:x1875769840146048:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:0.0:1788873846.458666:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+36:11168:x1875769840146048:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 363us (756us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788873846.458675:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:1.0:1788873846.510686:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859113984:0@lo:400:kworker.0 00000100:00100000:1.0:1788873846.510777:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873846.510912:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859113856:0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.510949:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873846.511015:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859114368:0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.511039:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873846.511062:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859114880:0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.511085:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873846.511127:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114880 00000100:00100000:0.0:1788873846.511136:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114880 00000100:00100000:0.0:1788873846.511197:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788873846.511230:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859114880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.511453:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859114880:12345-0@lo:400:kworker.0 Request processed in 224us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.511461:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788873846.511491:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873846.511505:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859113856 00000100:00100000:0.0:1788873846.511526:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859113856 00000100:00100000:0.0:1788873846.511558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788873846.511565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859113856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.511605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859113856:12345-0@lo:400:kworker.0 Request processed in 41us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.511611:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788873846.511657:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859113856:0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.511671:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859114880:0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.511722:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859113984 00000100:00100000:0.0:1788873846.511726:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859113984 00000100:00100000:0.0:1788873846.511754:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114368 00000100:00100000:0.0:1788873846.511757:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114368 00000100:00100000:0.0:1788873846.511785:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788873846.511792:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859113984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512020:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859113600:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512066:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.512095:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859114112:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512125:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.512144:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859114624:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512168:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.512193:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788873846.512200:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859113728:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512265:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.512279:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859114240:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512302:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.512312:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859114752:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512343:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.512368:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859113600 00000100:00100000:2.0:1788873846.512372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859113600 00000100:00100000:2.0:1788873846.512417:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788873846.512424:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859113600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512461:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34518e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859113600:12345-0@lo:400:kworker.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.512468:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788873846.512516:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114112 00000100:00100000:2.0:1788873846.512520:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114112 00000100:00100000:2.0:1788873846.512544:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788873846.512551:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859114112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512580:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859114112:12345-0@lo:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.512585:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788873846.512612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859113600:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512622:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859114112:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114624 00000100:00100000:2.0:1788873846.512652:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114624 00000100:00100000:2.0:1788873846.512672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859113728 00000100:00100000:2.0:1788873846.512675:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859113728 00000100:00100000:2.0:1788873846.512686:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114240 00000100:00100000:2.0:1788873846.512688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114240 00000100:00100000:2.0:1788873846.512700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114752 00000100:00100000:2.0:1788873846.512703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114752 00000100:00100000:2.0:1788873846.512717:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788873846.512723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.512762:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859114368:12345-0@lo:400:kworker.0 Request processed in 39us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.512769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788873846.512794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788873846.512801:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859114624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873846.515469:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788873846.515503:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859113728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.521443:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859113984:12345-0@lo:400:kworker.0 Request processed in 9633us (10647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.521465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788873846.521530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788873846.521553:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859114240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.521686:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859114240:12345-0@lo:400:kworker.0 Request processed in 147us (9383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.521694:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788873846.521725:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788873846.521734:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859114752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873846.521771:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859114752:12345-0@lo:400:kworker.0 Request processed in 39us (9427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.522714:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:0.0:1788873846.522772:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873846.522779:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873846.523154:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859113984:0@lo:400:kworker.0 00000100:00100000:1.0:1788873846.523176:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859114496:0@lo:400:kworker.0 00000100:00100000:1.0:1788873846.523280:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873846.523337:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859115008:0@lo:400:kworker.0 00000100:00100000:1.0:1788873846.523386:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873846.523629:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859114624:12345-0@lo:400:kworker.0 Request processed in 10826us (11457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.523640:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788873846.523700:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859114240:0@lo:400:kworker.0 00010000:00080000:2.0:1788873846.523721:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33427d0000 x1875769859114752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873846.523733:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859114752:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.523746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859114624:0@lo:400:kworker.0 00010000:00080000:2.0:1788873846.523790:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334401a680 x1875769859114368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873846.523813:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859114368:0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.523869:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859114496 00000100:00100000:2.0:1788873846.523877:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859114496 00000100:00100000:2.0:1788873846.523934:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859115008 00000100:00100000:2.0:1788873846.523937:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859115008 00000100:00100000:2.0:1788873846.523973:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788873846.523982:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859114496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.524048:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859114496:12345-0@lo:400:kworker.0 Request processed in 68us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.524056:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788873846.524072:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788873846.524079:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859115008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873846.524127:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859115008:12345-0@lo:400:kworker.0 Request processed in 49us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873846.524133:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788873846.524561:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859113728:12345-0@lo:400:kworker.0 Request processed in 9073us (12291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873846.524570:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788873846.524612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859113728:0@lo:400:kworker.0 00000100:00100000:1.0:1788873846.524746:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859114496:0@lo:400:kworker.0 00000100:00100000:1.0:1788873846.524759:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859115008:0@lo:400:kworker.0 00000100:00080000:0.0:1788873846.524854:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873846.727787:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.728120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840146304 00000100:00100000:0.0:1788873846.728134:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840146304 00000100:00100000:0.0:1788873846.728243:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:0.0:1788873846.728255:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+36:11199:x1875769840146304:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:0.0:1788873846.728290:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873846.728317:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9652 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.728485:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.728503:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.728517:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873846.728528:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788873846.728674:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9652 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.728690:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9652 expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.728698:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873846.728717:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873846.728721:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93600, rc 0) 00000100:00100000:0.0:1788873846.728914:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11199:x1875769840146304:12345-192.168.202.20@tcp:101:cat.0 Request processed in 660us (1140us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788873846.728922:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:3.0:1788873846.732159:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873846.735570:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.735723:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840146432 00000100:00100000:0.0:1788873846.735737:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840146432 00000100:00100000:0.0:1788873846.735812:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:0.0:1788873846.735836:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+38:2398:x1875769840146432:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873846.735858:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873846.735897:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9652 expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.735924:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873846.735931:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873846.736016:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+37:2398:x1875769840146432:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 183us (3869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.736025:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:2.0:1788873846.736494:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840146688 00000100:00100000:2.0:1788873846.736499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840146688 00000100:00100000:2.0:1788873846.736535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:2.0:1788873846.736541:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+37:11199:x1875769840146688:12345-192.168.202.20@tcp:35:cat.0 00000100:00100000:2.0:1788873846.736843:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11199:x1875769840146688:12345-192.168.202.20@tcp:35:cat.0 Request processed in 299us (1285us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788873846.736851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:3.0:1788873846.794164:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873846.794449:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840146944 00000100:00100000:2.0:1788873846.794466:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840146944 00000100:00100000:2.0:1788873846.794589:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:2.0:1788873846.794602:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11205:x1875769840146944:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:2.0:1788873846.794635:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873846.794640:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788873846.794678:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9b9d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9628 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.794704:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873846.794711:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873846.794730:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9ba7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9659 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.794911:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.794952:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.794964:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.795545:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873846.795563:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 38 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873846.795581:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859115136:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873846.795726:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873846.799190:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873846.799451:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840147072 00000100:00100000:1.0:1788873846.799466:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840147072 00010000:00010000:1.0:1788873846.799525:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 39 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873846.799582:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:1.0:1788873846.799594:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+39:2401:x1875769840147072:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873846.799614:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873846.799622:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 39 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.799638:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 39 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.799666:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873846.799672:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.799684:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.799694:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873846.799744:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873846.799938:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9ba52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a964b expref: 39 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873846.799960:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859115136:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873846.800066:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.800077:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.800083:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873846.800106:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788873846.800364:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9ba7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 40 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.800382:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 39 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873846.800391:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873846.800401:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788873846.800405:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e800, rc 0) 00000100:00100000:1.0:1788873846.800532:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+39:2401:x1875769840147072:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 938us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873846.800541:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:3.0:1788873846.807007:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11205:x1875769840146944:12345-192.168.202.20@tcp:101:dd.0 Request processed in 12386us (12840us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788873846.807026:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:3.0:1788873846.810835:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.810945:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840147200 00000100:00100000:0.0:1788873846.810959:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840147200 00000100:00100000:0.0:1788873846.811116:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:0.0:1788873846.811130:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11205:x1875769840147200:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:0.0:1788873846.811169:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873846.811252:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9660 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.811303:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.811359:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.811376:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.811554:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9ba91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.811580:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 39 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.811592:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873846.811596:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788873846.811601:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92000, rc 0) 00000100:00100000:0.0:1788873846.811674:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+39:11205:x1875769840147200:12345-192.168.202.20@tcp:101:dd.0 Request processed in 546us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873846.811681:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:2.0:1788873846.817776:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873846.817937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840147456 00000100:00100000:0.0:1788873846.817951:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840147456 00000100:00100000:0.0:1788873846.818055:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00100000:0.0:1788873846.818067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+39:11205:x1875769840147456:12345-192.168.202.20@tcp:36:dd.0 00010000:00010000:0.0:1788873846.818444:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.818470:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.818498:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873846.818560:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788873846.818588:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000322f4892 reply state 000000002c598f47 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.818604:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873846.818612:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873846.818615:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873846.818620:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873846.818743:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+42:11205:x1875769840147456:12345-192.168.202.20@tcp:36:dd.0 Request processed in 676us (988us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788873846.818752:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 62 00000020:00080000:0.0:1788873846.818759:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788873846.896146:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873847.024764:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859115264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873847.024912:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873847.025144:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859115264 00000100:00100000:2.0:1788873847.025156:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859115264 00000100:00100000:2.0:1788873847.025233:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788873847.025258:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859115264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873847.025304:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873847.025473:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873847.025485:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859115520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873847.025520:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873847.025550:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859115520 00000100:00100000:0.0:1788873847.025554:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859115520 00000100:00100000:0.0:1788873847.025584:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788873847.025590:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859115520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873847.025617:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873847.025651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859115520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873847.025659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788873847.025742:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859115520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873847.032950:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859115392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873847.033465:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873847.036375:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859115392 00000100:00100000:0.0:1788873847.036414:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859115392 00000100:00100000:0.0:1788873847.036518:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788873847.036532:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859115392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873847.036575:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873847.036694:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859115392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873847.036702:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788873847.037381:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859115392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873847.037648:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859115264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12389us (12734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873847.037658:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788873847.042128:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859115264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873847.127441:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873847.127961:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840147584 00000100:00100000:3.0:1788873847.127977:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840147584 00000100:00100000:3.0:1788873847.128078:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:3.0:1788873847.128090:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+42:11219:x1875769840147584:12345-192.168.202.20@tcp:101:stat.0 00010000:00010000:3.0:1788873847.128141:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873847.128176:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9baa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9667 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128335:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128359:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128380:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128419:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128428:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128437:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788873847.128447:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788873847.128549:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128563:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 43 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128573:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128619:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 43 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.128637:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 43 pid: 8450 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873847.128655:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859115648:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873847.128806:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873847.134431:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.134523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840147840 00000100:00100000:1.0:1788873847.134538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840147840 00000100:00100000:1.0:1788873847.134626:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:1.0:1788873847.134640:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+44:6172:x1875769840147840:12345-192.168.202.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788873847.135123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+45:6172:x1875769840147840:12345-192.168.202.20@tcp:35:ldlm_bl.0 Request processed in 483us (708us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788873847.135143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:2.0:1788873847.135409:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859115648:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873847.135463:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873847.138377:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873847.139356:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840147968 00000100:00100000:3.0:1788873847.139375:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840147968 00010000:00010000:3.0:1788873847.139466:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 45 pid: 8450 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873847.139532:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:3.0:1788873847.139546:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+45:2401:x1875769840147968:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873847.139569:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873847.139579:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 45 pid: 8450 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.139597:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 45 pid: 8450 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.139629:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9ba83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9659 expref: 45 pid: 8450 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.139656:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873847.139662:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.139674:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.139684:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.139723:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873847.139807:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+44:2401:x1875769840147968:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 264us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873847.139824:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 56 00010000:00010000:2.0:1788873847.142783:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.142817:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873847.142910:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788873847.142916:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873847.142987:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143018:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143033:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143041:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143049:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143055:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873847.143060:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143068:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143111:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873847.143114:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873847.143122:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143140:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9baad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143160:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143166:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143172:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143178:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873847.143181:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143187:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143196:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:2.0:1788873847.143198:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873847.143201:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143254:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143319:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9baa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9667 expref: 44 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143349:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9667 expref: 43 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.143358:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:2.0:1788873847.143361:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873847.143364:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443c00, rc 0) 00000100:00100000:2.0:1788873847.143470:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+43:11219:x1875769840147584:12345-192.168.202.20@tcp:101:stat.0 Request processed in 15380us (16043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873847.143481:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:2.0:1788873847.254890:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873847.255024:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148224 00000100:00100000:0.0:1788873847.255038:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148224 00000100:00100000:0.0:1788873847.255136:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:0.0:1788873847.255150:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+43:11225:x1875769840148224:12345-192.168.202.20@tcp:36:truncate.0 00010000:00010000:0.0:1788873847.255300:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873847.255350:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9babb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9667 expref: 43 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.255377:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873847.255385:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873847.255658:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.255678:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.255691:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873847.255784:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788873847.255808:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013b0fde9 reply state 000000002e28b509 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.255822:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.255828:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873847.255831:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873847.255834:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873847.255982:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+45:11225:x1875769840148224:12345-192.168.202.20@tcp:36:truncate.0 Request processed in 834us (1107us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788873847.255990:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 64 00000020:00080000:0.0:1788873847.255996:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788873847.435764:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.436068:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148352 00000100:00100000:1.0:1788873847.436085:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148352 00000100:00100000:1.0:1788873847.436180:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 379 00000100:00100000:1.0:1788873847.436195:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840148352:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873847.436360:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d348206d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840148352:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 167us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873847.436369:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 379 00000100:00100000:3.0:1788873847.444558:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.444690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148480 00000100:00100000:2.0:1788873847.444704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148480 00000100:00100000:2.0:1788873847.444807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 293 00000100:00100000:2.0:1788873847.444826:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840148480:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873847.444928:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840148480:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 104us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873847.444936:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 293 00000100:00080000:0.0:1788873847.445172:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873847.447944:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873847.448112:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.448255:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148736 00000100:00100000:2.0:1788873847.448281:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148736 00000100:00100000:2.0:1788873847.448400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 294 00000100:00100000:2.0:1788873847.448412:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840148736:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873847.448513:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840148736:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 102us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873847.448541:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 294 00000100:00100000:3.0:1788873847.449501:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00080000:1.0:1788873847.449918:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873847.450109:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148864 00000100:00100000:2.0:1788873847.450121:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148864 00000100:00100000:2.0:1788873847.450278:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 295 00000100:00100000:2.0:1788873847.450290:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840148864:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873847.450381:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840148864:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 94us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873847.450390:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 295 00000100:00100000:0.0:1788873847.456886:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148608 00000100:00100000:0.0:1788873847.456913:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148608 00000100:00100000:0.0:1788873847.457024:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 112 00000100:00100000:0.0:1788873847.457039:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840148608:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873847.457168:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840148608:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 131us (9054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873847.457176:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 112 00000100:00080000:1.0:1788873847.458279:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873847.460313:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.460492:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840148992 00000100:00100000:1.0:1788873847.460505:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840148992 00000100:00100000:1.0:1788873847.460581:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:1.0:1788873847.460593:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+45:11239:x1875769840148992:12345-192.168.202.20@tcp:101:stat.0 00010000:00010000:1.0:1788873847.460643:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873847.460670:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a966e expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.460756:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.460776:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.460791:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.460974:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.460984:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.460991:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461200:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461240:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461247:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873847.461384:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788873847.461397:0:8993:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873847.461427:0:8993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461441:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461449:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461456:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461463:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461470:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873847.461475:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461484:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461497:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:1.0:1788873847.461500:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873847.461506:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461512:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461528:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461546:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461552:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461557:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873847.461561:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461568:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461576:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:1.0:1788873847.461579:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873847.461582:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461588:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461626:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 47 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461640:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 46 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.461648:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873847.461650:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873847.461660:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecae00, rc 0) 00000100:00100000:1.0:1788873847.461759:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+46:11239:x1875769840148992:12345-192.168.202.20@tcp:101:stat.0 Request processed in 1168us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873847.461767:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:3.0:1788873847.563798:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.564060:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840149248 00000100:00100000:2.0:1788873847.564074:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840149248 00000100:00100000:2.0:1788873847.564250:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:2.0:1788873847.564274:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+46:11250:x1875769840149248:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873847.564301:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873847.564361:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9675 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873847.564496:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788873847.564629:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bae5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9675 expref: 48 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.564646:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:2.0:1788873847.564650:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873847.564657:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9675 expref: 48 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.564675:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873847.564777:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+47:11250:x1875769840149248:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 516us (995us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788873847.564785:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:3.0:1788873847.566977:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.567120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840149504 00000100:00100000:1.0:1788873847.567132:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840149504 00000100:00100000:1.0:1788873847.567194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:1.0:1788873847.567229:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+47:11250:x1875769840149504:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:1.0:1788873847.567583:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+48:11250:x1875769840149504:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 380us (620us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788873847.567589:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:3.0:1788873847.604688:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.604844:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840149760 00000100:00100000:2.0:1788873847.604857:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840149760 00000100:00100000:2.0:1788873847.604936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:2.0:1788873847.604949:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+48:11256:x1875769840149760:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873847.604984:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873847.605014:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9baf3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a967c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.605165:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.605183:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 49 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.605193:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.605275:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 49 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.605290:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 49 pid: 8993 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873847.605307:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859115776:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873847.605982:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873847.608085:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859115776:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873847.608128:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873847.611153:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.611344:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840149888 00000100:00100000:1.0:1788873847.611359:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840149888 00010000:00010000:1.0:1788873847.611421:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 50 pid: 8993 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873847.611482:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:1.0:1788873847.611496:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458495450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+50:2400:x1875769840149888:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873847.611529:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873847.611538:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 50 pid: 8993 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.611553:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 50 pid: 8993 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.611583:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a966e expref: 50 pid: 8993 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.611630:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873847.611637:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.611649:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.611659:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.611705:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873847.611784:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458495450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+49:2400:x1875769840149888:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 290us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873847.611791:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00010000:00010000:3.0:1788873847.612035:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.612046:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873847.612072:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788873847.612293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9baf3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.612314:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.612331:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873847.612334:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788873847.612337:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ec00, rc 0) 00000100:00100000:3.0:1788873847.612371:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+49:11256:x1875769840149760:12345-192.168.202.20@tcp:101:bash.0 Request processed in 7425us (7699us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788873847.612378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:3.0:1788873847.616737:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.616897:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840150144 00000100:00100000:1.0:1788873847.616912:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840150144 00000100:00100000:1.0:1788873847.616995:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:1.0:1788873847.617010:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+49:11256:x1875769840150144:12345-192.168.202.20@tcp:36:bash.0 00010000:00010000:1.0:1788873847.617420:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.617449:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.617463:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788873847.617536:0:8993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788873847.617564:0:8993:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc73aef7 reply state 000000009c9a8468 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.617599:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.617608:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873847.617611:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873847.617616:0:8993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873847.617731:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11256:x1875769840150144:12345-192.168.202.20@tcp:36:bash.0 Request processed in 723us (1006us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788873847.617740:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 68 00000020:00080000:1.0:1788873847.617747:0:8993:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788873847.630830:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.631395:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840150272 00000100:00100000:2.0:1788873847.631412:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840150272 00000100:00100000:2.0:1788873847.631496:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:2.0:1788873847.631521:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11256:x1875769840150272:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873847.631561:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873847.631593:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9683 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.631738:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.631759:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.631770:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.631832:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.631849:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 53 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873847.631867:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859115904:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873847.632011:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873847.636450:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873847.636558:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840150400 00000100:00100000:0.0:1788873847.636574:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840150400 00010000:00010000:0.0:1788873847.636644:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 54 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873847.636859:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859115904:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873847.636902:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873847.636942:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:0.0:1788873847.636955:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:2400:x1875769840150400:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873847.636976:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873847.636985:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 54 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.636999:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 54 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.637029:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bafa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a967c expref: 54 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.637049:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873847.637055:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.637068:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.637079:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.637123:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873847.637262:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+53:2400:x1875769840150400:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 309us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873847.637270:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 58 00010000:00010000:2.0:1788873847.637343:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.637352:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873847.637439:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788873847.637445:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873847.637481:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.637538:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9683 expref: 53 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.637558:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9683 expref: 52 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.637567:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:2.0:1788873847.637570:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873847.637574:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873847.637609:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11256:x1875769840150272:12345-192.168.202.20@tcp:101:bash.0 Request processed in 6103us (6801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873847.637617:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:0.0:1788873847.640372:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.640453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840150656 00000100:00100000:2.0:1788873847.640467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840150656 00000100:00100000:2.0:1788873847.640562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:2.0:1788873847.640581:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11256:x1875769840150656:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:2.0:1788873847.640884:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+53:11256:x1875769840150656:12345-192.168.202.20@tcp:35:bash.0 Request processed in 303us (526us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788873847.640893:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:1.0:1788873847.723520:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.723714:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840150912 00000100:00100000:2.0:1788873847.723730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840150912 00000100:00100000:2.0:1788873847.723827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 70 00000100:00100000:2.0:1788873847.723842:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+53:11266:x1875769840150912:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873847.723877:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873847.723912:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a968a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873847.724064:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788873847.724556:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a968a expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.724578:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:2.0:1788873847.724582:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873847.724589:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a968a expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.724608:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ee00, rc 0) 00000100:00100000:2.0:1788873847.724709:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11266:x1875769840150912:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 870us (1209us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788873847.724719:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 70 00000100:00100000:3.0:1788873847.728991:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873847.729460:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840151040 00000100:00100000:0.0:1788873847.729479:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840151040 00000100:00100000:0.0:1788873847.729566:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 71 00000100:00100000:0.0:1788873847.729581:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11266:x1875769840151040:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:0.0:1788873847.729709:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.729734:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.729751:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.729766:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.729775:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.729782:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730127:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730139:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730148:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873847.730383:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730419:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730426:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730433:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730438:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873847.730442:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730451:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730466:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873847.730470:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873847.730475:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730482:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bb2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730496:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730503:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730509:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730521:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873847.730524:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730531:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730540:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:0.0:1788873847.730543:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873847.730546:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730552:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bb32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730563:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730571:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730577:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730583:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873847.730586:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730593:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730614:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873847.730616:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873847.730620:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873847.730626:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bb39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873847.730901:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11266:x1875769840151040:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 1317us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873847.730913:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 71 00000100:00100000:0.0:1788873847.735359:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.735512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840151296 00000100:00100000:2.0:1788873847.735548:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840151296 00000100:00100000:2.0:1788873847.735626:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:2.0:1788873847.735640:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11266:x1875769840151296:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873847.735972:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+55:11266:x1875769840151296:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 333us (629us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788873847.735980:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:1.0:1788873847.769485:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.769624:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840151552 00000100:00100000:2.0:1788873847.769640:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840151552 00000100:00100000:2.0:1788873847.769721:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 72 00000100:00100000:2.0:1788873847.769733:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+55:11269:x1875769840151552:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873847.769766:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873847.769796:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9691 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.769914:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.769934:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.769950:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.769964:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.769971:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.769978:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770165:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bb55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770175:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bb55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770183:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bb55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873847.770194:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788873847.770357:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770366:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770374:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770381:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873847.770387:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770398:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770414:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873847.770418:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873847.770423:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770441:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bb47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770461:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770468:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770474:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770478:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873847.770481:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770487:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770495:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:2.0:1788873847.770498:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873847.770501:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770508:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bb4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770559:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bb40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9691 expref: 58 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770574:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bb55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9691 expref: 57 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873847.770589:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:2.0:1788873847.770591:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873847.770595:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030000, rc 0) 00000100:00100000:2.0:1788873847.770937:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+57:11269:x1875769840151552:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1203us (1465us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788873847.770946:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 72 00000100:00100000:2.0:1788873847.776395:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.776518:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873847.776621:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840151808 00000100:00100000:3.0:1788873847.776635:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840151808 00000100:00100000:3.0:1788873847.776723:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:3.0:1788873847.776739:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+57:2400:x1875769840151808:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873847.776760:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873847.776814:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bb55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9691 expref: 57 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.776839:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873847.776846:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873847.776924:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+56:2400:x1875769840151808:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 190us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873847.776933:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:1.0:1788873847.778431:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840151680 00000100:00100000:1.0:1788873847.778448:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840151680 00000100:00100000:1.0:1788873847.778552:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 73 00000100:00100000:1.0:1788873847.778565:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+56:11269:x1875769840151680:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:1.0:1788873847.778662:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778701:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778716:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778773:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778783:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778830:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778837:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873847.778843:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778855:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778868:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873847.778872:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788873847.778878:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.778886:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873847.778975:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+56:11269:x1875769840151680:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 413us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873847.778984:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 73 00000100:00100000:2.0:1788873847.783022:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873847.783129:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840152064 00000100:00100000:0.0:1788873847.783144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840152064 00000100:00100000:0.0:1788873847.783250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:0.0:1788873847.783264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+56:11269:x1875769840152064:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:0.0:1788873847.783633:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+57:11269:x1875769840152064:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 370us (624us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788873847.783645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00010000:00010000:0.0:1788873847.919655:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873847.921419:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.921984:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840152320 00000100:00100000:2.0:1788873847.922012:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840152320 00000100:00100000:3.0:1788873847.922241:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 74 00000100:00100000:3.0:1788873847.922258:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+57:11287:x1875769840152320:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:3.0:1788873847.922293:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873847.922346:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bb6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9698 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.922510:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.922529:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.922568:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873847.922584:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788873847.922727:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bb6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9698 expref: 60 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.922751:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9698 expref: 59 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.922761:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873847.922765:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788873847.922769:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442e00, rc 0) 00000100:00100000:3.0:1788873847.923358:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11287:x1875769840152320:12345-192.168.202.20@tcp:101:cat.0 Request processed in 1102us (1948us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788873847.923367:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 74 00000100:00100000:2.0:1788873847.955188:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873847.955364:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840152448 00000100:00100000:3.0:1788873847.955381:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840152448 00000100:00100000:3.0:1788873847.955474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 75 00000100:00100000:3.0:1788873847.955486:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11288:x1875769840152448:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873847.955521:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873847.955549:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bb7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a969f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.955643:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9bb86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.955680:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9bb86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.955696:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9bb86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873847.955759:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788873847.955764:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873847.955789:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9bb86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.955842:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bb7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a969f expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.955867:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9bb86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a969f expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.955878:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:3.0:1788873847.955882:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873847.955887:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443c00, rc 0) 00000100:00100000:3.0:1788873847.955959:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11288:x1875769840152448:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 475us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873847.955968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 75 00000100:00100000:0.0:1788873847.964141:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873847.964269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840152832 00000100:00100000:2.0:1788873847.964285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840152832 00000100:00100000:2.0:1788873847.964374:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:2.0:1788873847.964387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11288:x1875769840152832:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873847.964837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11288:x1875769840152832:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 450us (710us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788873847.964847:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:0.0:1788873847.968658:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873847.968759:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840152960 00000100:00100000:3.0:1788873847.968774:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840152960 00000100:00100000:3.0:1788873847.968863:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:3.0:1788873847.968875:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11288:x1875769840152960:12345-192.168.202.20@tcp:103:lfs.0 00010000:00010000:3.0:1788873847.968895:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788873847.968947:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bb16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9683 expref: 61 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.968975:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9698 expref: 60 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.968989:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ba13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a963d expref: 59 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873847.968999:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873847.969005:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873847.969077:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+58:11288:x1875769840152960:12345-192.168.202.20@tcp:103:lfs.0 Request processed in 205us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873847.969092:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:0.0:1788873847.973040:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873847.973260:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840153088 00000100:00100000:1.0:1788873847.973274:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840153088 00000100:00100000:1.0:1788873847.973369:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 76 00000100:00100000:1.0:1788873847.973383:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+58:11288:x1875769840153088:12345-192.168.202.20@tcp:58:lfs.0 00010000:00010000:1.0:1788873847.973595:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.973620:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873847.973646:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873847.974024:0:8993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873847.974336:0:8993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788873847.974443:0:8993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788873847.974592:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+58:11288:x1875769840153088:12345-192.168.202.20@tcp:58:lfs.0 Request processed in 1207us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873847.974602:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 76 00000100:00100000:2.0:1788873848.002664:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.002766:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840153216 00000100:00100000:3.0:1788873848.002781:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840153216 00000100:00100000:3.0:1788873848.002875:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 77 00000100:00100000:3.0:1788873848.002888:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+58:11290:x1875769840153216:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873848.002919:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873848.002950:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bb94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96a6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003063:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003083:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003400:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003432:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003440:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003448:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003555:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003567:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003574:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873848.003632:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788873848.003637:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873848.003660:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003674:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003684:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003691:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003709:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003716:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.003721:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003731:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003747:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:3.0:1788873848.003750:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873848.003757:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003763:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bb9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003780:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003786:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003792:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.003798:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.004308:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.004342:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.004355:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:3.0:1788873848.004357:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873848.004361:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.004367:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.004412:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bb94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 60 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.004428:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 59 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.004436:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873848.004439:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873848.004441:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873848.004538:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11290:x1875769840153216:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1652us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.004548:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 77 00000040:00080000:3.0:1788873848.494865:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788873848.497982:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873848.497991:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788873848.498032:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788873848.498039:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788873848.498173:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4cdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859116032:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788873848.498293:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873848.511527:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.511559:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840153344 00000100:00100000:2.0:1788873848.511568:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840153344 00000100:00100000:2.0:1788873848.511620:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 78 00000100:00100000:2.0:1788873848.511630:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840153344:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788873848.511675:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788873848.511784:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840153344:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 156us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873848.511792:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 78 00000100:00100000:2.0:1788873848.511929:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4cdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859116032:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788873848.524655:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.524688:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840153472 00000100:00100000:3.0:1788873848.524699:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840153472 00000100:00100000:3.0:1788873848.524742:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 79 00000100:00100000:3.0:1788873848.524751:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11301:x1875769840153472:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788873848.524825:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524843:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524856:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524915:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524923:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524930:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524957:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524966:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.524972:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873848.525023:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788873848.525027:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873848.525040:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525051:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525058:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525065:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525072:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.525076:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525083:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525097:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:3.0:1788873848.525100:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873848.525105:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525112:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bbb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525123:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525138:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525144:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525149:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.525152:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525158:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525166:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9d3476dc2600) 00010000:00010000:3.0:1788873848.525169:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873848.525172:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525178:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9bbb7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525194:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525199:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525228:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525233:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.525242:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525248:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525269:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873848.525272:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873848.525275:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.525281:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bbbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.525361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11301:x1875769840153472:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 Request processed in 609us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.525370:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 79 00000100:00100000:3.0:1788873848.528171:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.528300:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840153728 00000100:00100000:1.0:1788873848.528320:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840153728 00000100:00100000:1.0:1788873848.528391:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 80 00000100:00100000:1.0:1788873848.528402:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11301:x1875769840153728:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788873848.528424:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873848.528448:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bbc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96ad expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528583:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528598:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528611:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873848.528622:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788873848.528703:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528720:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528726:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528733:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873848.528738:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528746:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528757:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873848.528760:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873848.528766:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528772:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bbcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528824:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bbc5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ad expref: 61 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528835:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:1.0:1788873848.528837:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788873848.528841:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bbc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ad expref: 61 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.528850:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca600, rc 0) 00000100:00100000:1.0:1788873848.528910:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840153728:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 510us (750us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788873848.528917:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 80 00000100:00100000:3.0:1788873848.536125:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.536518:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840153856 00000100:00100000:1.0:1788873848.536531:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840153856 00000100:00100000:1.0:1788873848.536587:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:1.0:1788873848.536600:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840153856:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788873848.536643:0:8993:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788873848.536783:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840153856:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 185us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873848.536791:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:3.0:1788873848.544581:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.545390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840154112 00000100:00100000:2.0:1788873848.545405:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840154112 00000100:00100000:2.0:1788873848.545466:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 82 00000100:00100000:2.0:1788873848.545477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840154112:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873848.545499:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873848.545503:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788873848.545530:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9bb86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a969f expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.545549:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873848.545555:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873848.545574:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873848.546151:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788873848.547056:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bbe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.547073:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.547086:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.547160:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96b4 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.547178:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96b4 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.547187:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc6a00) 00010000:00010000:2.0:1788873848.547190:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873848.547194:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030c00, rc 0) 00000100:00100000:2.0:1788873848.548097:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11301:x1875769840154112:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 2613us (3521us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788873848.548109:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 82 00000100:00100000:1.0:1788873848.559972:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.560409:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840154368 00000100:00100000:2.0:1788873848.560420:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840154368 00000100:00100000:2.0:1788873848.560517:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 83 00000100:00100000:2.0:1788873848.560528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11301:x1875769840154368:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788873848.560604:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873848.560631:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bbe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96b4 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560649:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc6a00) 00010000:00010000:2.0:1788873848.560660:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873848.560681:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560696:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560713:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560729:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560736:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560742:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560786:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.560793:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561760:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561772:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873848.561777:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561786:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561797:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873848.561869:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873848.561874:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561889:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bbef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561901:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561908:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561914:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561919:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873848.561923:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561929:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561937:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe17e8207 (ffff9d3476dc6100) 00010000:00010000:2.0:1788873848.561940:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873848.561943:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.561949:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bbf6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe17e8207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873848.562044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840154368:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 1516us (2080us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873848.562053:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 83 00000100:00100000:2.0:1788873848.569902:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.569979:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840154496 00000100:00100000:3.0:1788873848.569989:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840154496 00000100:00100000:3.0:1788873848.570053:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 84 00000100:00100000:3.0:1788873848.570065:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11301:x1875769840154496:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873848.570091:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873848.570114:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bbfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96bb expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.570154:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.570175:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.570187:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.570462:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bbfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 62 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.570476:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 61 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.570484:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:3.0:1788873848.570487:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788873848.570490:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442e00, rc 0) 00000100:00100000:3.0:1788873848.570555:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11301:x1875769840154496:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 492us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.570562:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 84 00000100:00100000:0.0:1788873848.577163:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.577291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840154752 00000100:00100000:2.0:1788873848.577301:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840154752 00000100:00100000:2.0:1788873848.577367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 85 00000100:00100000:2.0:1788873848.577379:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11301:x1875769840154752:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788873848.577472:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.577491:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.577504:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873848.577674:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788873848.577684:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385523478555ns, next at 386523476048ns, rc = 0 00000004:00010000:2.0:1788873848.577734:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5d8b7b7 reply state 00000000fcc7c9db transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.577746:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.577754:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:2.0:1788873848.577756:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788873848.577760:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788873848.578014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11301:x1875769840154752:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 636us (859us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788873848.578021:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 85 00000001:00080000:0.0:1788873848.585659:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1788873848.585673:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1788873848.585745:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788873848.585766:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3342753d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788873848.585772:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a77a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3342753000 00000020:00080000:0.0:1788873848.585775:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a77a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3445f46400 00000100:00100000:2.0:1788873848.586121:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33427d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859116160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788873848.586192:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873848.586363:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586374:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586382:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586389:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586393:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586401:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586416:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d33410dd900) 00010000:00010000:0.0:1788873848.586419:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873848.586423:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586429:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9b94f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586448:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586463:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586469:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586473:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586475:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586481:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586488:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873848.586490:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873848.586493:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586499:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9b956 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586516:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586521:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586526:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586531:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586540:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586545:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586552:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd600) 00010000:00010000:0.0:1788873848.586554:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873848.586556:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586562:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9b995 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586578:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586584:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586589:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586594:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586597:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586602:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586609:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873848.586611:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873848.586619:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586625:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9ba9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586637:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586643:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586648:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586653:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586656:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586661:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586668:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873848.586670:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873848.586672:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586678:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bac2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586686:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586692:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586704:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586709:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecac00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586713:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586720:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586729:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:0.0:1788873848.586732:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873848.586735:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586740:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bb08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586751:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586757:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586764:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586768:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873848.586771:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586787:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.586795:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:0.0:1788873848.586797:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788873848.587379:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859116160 00000100:00100000:2.0:1788873848.587388:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859116160 00000100:00100000:2.0:1788873848.587445:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788873848.587456:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875769859116160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788873848.587481:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788873848.587511:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa00c76, atime: 0x6aa00c76, ctime: 0x6aa00c76, blocks: 0x8 00010000:00010000:2.0:1788873848.587517:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.587532:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788873848.587536:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873848.587543:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.587559:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.587568:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.587576:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.587592:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788873848.587753:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3634:x1875769859116160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (1560us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788873848.587760:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788873848.587796:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1788873848.588467:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788873848.588617:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788873848.588739:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.588765:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840154880 00000100:00100000:3.0:1788873848.588771:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840154880 00010000:00010000:0.0:1788873848.588954:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.588963:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bc0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.589062:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873848.589069:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.589078:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030c00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873848.589082:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.589091:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.589105:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.589112:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9bc12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.589140:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873848.589142:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873848.589143:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788873848.589324:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d33427d2d80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788873848.589331:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33427d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859116160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788873848.589998:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 86 00000100:00100000:3.0:1788873848.590011:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+12:11301:x1875769840154880:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873848.590032:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873848.590047:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96c2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.590105:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.590119:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.590137:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:3.0:1788873848.590140:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873848.590142:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443600, rc 0) 00000100:00100000:3.0:1788873848.590222:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+13:11301:x1875769840154880:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 198us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.590228:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 86 00000100:00100000:3.0:1788873848.590451:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859116288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788873848.590494:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873848.590881:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859116288 00000100:00100000:0.0:1788873848.590950:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859116288 00000100:00100000:0.0:1788873848.591000:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788873848.591007:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859116288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788873848.591157:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875769859116288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (662us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788873848.591164:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:3.0:1788873848.591608:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343bc0000/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788873848.591614:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859116288:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788873848.591718:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873848.599245:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.599505:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840155008 00000100:00100000:1.0:1788873848.599515:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840155008 00000100:00100000:1.0:1788873848.599596:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:1.0:1788873848.599605:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875769840155008:12345-192.168.202.20@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788873848.599640:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:1.0:1788873848.599672:0:8425:0:(genops.c:1385:class_connect()) connect: client 64e5d878-4280-4742-8a19-a12ccf17cae7, cookie 0x25c660afb0a9bc20 00002000:00100000:1.0:1788873848.599684:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64e5d878-4280-4742-8a19-a12ccf17cae7/ffff9d34452a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788873848.599701:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788873848.599767:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788873848.599809:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d34452a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788873848.599869:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2397:x1875769840155008:12345-192.168.202.20@tcp:8:lhsmtool_posix.0 Request processed in 264us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873848.599877:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:2.0:1788873848.603437:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873848.603925:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840155136 00000100:00100000:0.0:1788873848.603936:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840155136 00000100:00100000:0.0:1788873848.604012:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788873848.604022:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:0:x1875769840155136:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788873848.604401:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788873848.605775:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00100000:1.0:1788873848.605787:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000001:00080000:1.0:1788873848.605792:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788873848.606016:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:0:x1875769840155136:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 1989us (2585us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788873848.606027:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:2.0:1788873848.610837:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873848.610984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840155392 00000100:00100000:0.0:1788873848.610996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840155392 00000100:00100000:0.0:1788873848.611059:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:0.0:1788873848.611071:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+13:11301:x1875769840155392:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788873848.611372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+14:11301:x1875769840155392:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 302us (548us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788873848.611380:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:2.0:1788873848.614983:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873848.615143:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840155648 00000100:00100000:0.0:1788873848.615153:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840155648 00000100:00100000:0.0:1788873848.615259:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 87 00000100:00100000:0.0:1788873848.615269:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+14:11301:x1875769840155648:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788873848.615394:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+14:11301:x1875769840155648:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 125us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873848.615401:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 87 00000100:00100000:2.0:1788873848.619174:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873848.619475:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840155776 00000100:00100000:0.0:1788873848.619485:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840155776 00000100:00100000:0.0:1788873848.619549:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 88 00000100:00100000:0.0:1788873848.619559:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+14:11301:x1875769840155776:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873848.619582:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873848.619604:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.619671:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.619685:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.619697:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873848.619740:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873848.619759:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.619785:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c9 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.619950:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c9 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.619960:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:0.0:1788873848.619963:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788873848.619967:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92800, rc 0) 00000100:00100000:0.0:1788873848.620183:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840155776:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 624us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873848.620190:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 88 00000100:00100000:2.0:1788873848.626510:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873848.626602:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840155904 00000100:00100000:0.0:1788873848.626612:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840155904 00000100:00100000:0.0:1788873848.626708:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:0.0:1788873848.626719:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840155904:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873848.626739:0:8789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873848.626761:0:8789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96d0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788873848.626785:0:8789:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa00c79, blocks: 0x0 00010000:00010000:0.0:1788873848.626817:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1788873848.626822:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873848.626831:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 6 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.626852:0:8789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 6 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.626893:0:8789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92400, rc 0) 00000100:00100000:0.0:1788873848.626956:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840155904:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 238us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873848.626962:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:2.0:1788873848.630359:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.630504:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840156160 00000100:00100000:3.0:1788873848.630515:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840156160 00000100:00100000:3.0:1788873848.630586:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 89 00000100:00100000:3.0:1788873848.630597:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840156160:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788873848.630707:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840156160:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 111us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.630714:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 89 00000100:00100000:2.0:1788873848.634527:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.634618:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840156288 00000100:00100000:3.0:1788873848.634642:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840156288 00000100:00100000:3.0:1788873848.634697:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:3.0:1788873848.634707:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:11301:x1875769840156288:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873848.634725:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873848.634745:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96d7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.634776:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.634786:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873848.634791:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873848.634796:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.634843:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.634858:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.634872:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875769859116416:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873848.635104:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873848.648475:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875769859116416:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873848.648510:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.648532:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442600, rc 0) 00000100:00100000:2.0:1788873848.648590:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11301:x1875769840156288:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 13884us (14077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873848.648599:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:3.0:1788873848.649294:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.649389:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840156416 00000100:00100000:3.0:1788873848.649397:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840156416 00010000:00010000:3.0:1788873848.649433:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.649463:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:3.0:1788873848.649472:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840156416:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873848.649484:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873848.649502:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.649514:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.649537:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9bc35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d0 expref: 7 pid: 8789 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.649552:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873848.649557:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873848.649565:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.649574:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.649602:0:9516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.649626:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9516:1875769859116544:192.168.202.20@tcp:105: 00000100:00100000:3.0:1788873848.649679:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873848.655872:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9516:1875769859116544:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788873848.656527:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873848.656786:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840156416:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 7310us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873848.656805:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:3.0:1788873848.666699:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.667965:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840156544 00000100:00100000:1.0:1788873848.667979:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840156544 00002000:00100000:1.0:1788873848.668045:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d347f4cf100 x1875769840156544/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:264/0 lens 504/0 e 0 to 0 dl 1788873859 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873848.668058:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f4cf100 with x1875769840156544 ext(0->8) 00002000:00010000:1.0:1788873848.668064:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d347f4cf100 00000100:00100000:1.0:1788873848.668099:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:1.0:1788873848.668109:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840156544:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788873848.670504:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840156544:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 Request processed in 2385us (3804us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788873848.670518:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00002000:00100000:1.0:1788873848.670531:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d347f4cf100 x1875769840156544/t4294967304(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:264/0 lens 504/448 e 0 to 0 dl 1788873859 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873848.670541:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f4cf100 with x1875769840156544 ext(0->8) 00002000:00010000:1.0:1788873848.670547:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d347f4cf100 00000100:00100000:2.0:1788873848.682488:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.682528:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840156672 00000100:00100000:2.0:1788873848.682536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840156672 00000100:00100000:2.0:1788873848.682583:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00100000:2.0:1788873848.682593:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840156672:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788873848.682719:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840156672:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 Request processed in 127us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873848.682732:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00100000:2.0:1788873848.686981:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.687028:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840156800 00000100:00100000:2.0:1788873848.687038:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840156800 00000100:00100000:2.0:1788873848.687088:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 38 00000100:00100000:2.0:1788873848.687099:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2398:x1875769840156800:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788873848.698408:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1788873848.698535:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840156800:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 Request processed in 11432us (11554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873848.698545:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 38 00000100:00100000:3.0:1788873848.715774:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.716249:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840157056 00000100:00100000:1.0:1788873848.716259:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840157056 00000100:00100000:1.0:1788873848.716324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 91 00000100:00100000:1.0:1788873848.716334:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840157056:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788873848.716385:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873848.716412:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c9 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.716443:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:1.0:1788873848.716448:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873848.716481:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.716495:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.716505:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873848.716619:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff3b28b6 reply state 000000009344348c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.716631:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.716637:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:1.0:1788873848.716640:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873848.716642:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873848.716735:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11301:x1875769840157056:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 401us (971us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788873848.716742:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 91 00000100:00100000:2.0:1788873848.738845:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.738994:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840157184 00000100:00100000:3.0:1788873848.739006:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840157184 00000100:00100000:3.0:1788873848.739067:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 39 00000100:00100000:3.0:1788873848.739076:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840157184:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788873848.739467:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788873848.739472:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788873848 00002000:00010000:1.0:1788873848.739475:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788873846 00002000:00010000:1.0:1788873848.739477:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788873849 -> 1788873848 00002000:00010000:1.0:1788873848.739480:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788873848.739548:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840157184:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 471us (711us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788873848.739572:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 39 00000100:00100000:2.0:1788873848.751237:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.751361:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840157440 00000100:00100000:3.0:1788873848.751371:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840157440 00000100:00100000:3.0:1788873848.751432:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 92 00000100:00100000:3.0:1788873848.751443:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11301:x1875769840157440:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788873848.751515:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.751533:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 16 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.751543:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.751576:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 16 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.751591:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 16 pid: 8993 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.751619:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859116672:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873848.751711:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788873848.755077:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.755124:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840157568 00000100:00100000:3.0:1788873848.755133:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840157568 00010000:00010000:3.0:1788873848.755183:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 17 pid: 8993 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.755240:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:3.0:1788873848.755251:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+17:2401:x1875769840157568:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873848.755266:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873848.755274:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 17 pid: 8993 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.755287:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 17 pid: 8993 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.755342:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:3.0:1788873848.755347:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.755357:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.755369:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.755408:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873848.755464:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+17:2401:x1875769840157568:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 215us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.755479:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 60 00010000:00010000:1.0:1788873848.756455:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9bc04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96bb expref: 16 pid: 8993 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873848.756488:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859116672:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873848.756521:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756533:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756540:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756600:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756609:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756618:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756625:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873848.756632:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756642:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756688:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:1.0:1788873848.756691:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788873848.756698:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.756705:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9bc4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873848.756934:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840157440:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 Request processed in 5490us (5731us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788873848.756946:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 92 00000100:00100000:3.0:1788873848.763857:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.764155:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840157696 00000100:00100000:2.0:1788873848.764171:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840157696 00000100:00100000:2.0:1788873848.764931:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:2.0:1788873848.764949:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840157696:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788873848.765022:0:8789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.765050:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.765062:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873848.765069:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873848.765076:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.765165:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.765187:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 7 pid: 8427 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873848.765260:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859116800:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873848.765403:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873848.770489:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859116800:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873848.770531:0:8789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.776839:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873848.776927:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840157824 00000100:00100000:0.0:1788873848.776943:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840157824 00010000:00010000:0.0:1788873848.777007:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 8 pid: 8427 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873848.777056:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:0.0:1788873848.777067:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2399:x1875769840157824:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873848.777083:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873848.777102:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 8 pid: 8427 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.777127:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 8 pid: 8427 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.777150:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009815f977/0x25c660afb0a9bc3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96d7 expref: 8 pid: 8427 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.777184:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873848.777189:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873848.777196:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.777230:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.777267:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873848.777342:0:8789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873848.777343:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840157824:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 275us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873848.777373:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 61 00010000:00010000:3.0:1788873848.777376:0:8789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777414:0:8789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777424:0:8789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777434:0:8789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777443:0:8789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873848.777449:0:8789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777460:0:8789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777490:0:8789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.777500:0:8789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bc51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.777591:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840157696:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 Request processed in 12646us (13747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.777602:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:2.0:1788873848.795641:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.796975:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840158080 00000100:00100000:3.0:1788873848.796993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840158080 00000100:00100000:3.0:1788873848.797088:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 93 00000100:00100000:3.0:1788873848.797101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+15:11301:x1875769840158080:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788873848.797272:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.797296:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.797315:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.797367:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.797385:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 15 pid: 6509 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.797419:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859116928:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873848.797532:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873848.802029:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.802092:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840158208 00000100:00100000:1.0:1788873848.802104:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840158208 00010000:00010000:1.0:1788873848.802155:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 16 pid: 6509 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873848.802334:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00100000:1.0:1788873848.802350:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458496050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+16:2401:x1875769840158208:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873848.802368:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873848.802376:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 16 pid: 6509 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.802393:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 16 pid: 6509 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.802424:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873848.802445:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.802458:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.802467:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.802494:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873848.802552:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458496050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+16:2401:x1875769840158208:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 206us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873848.802559:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 62 00010000:00010000:3.0:1788873848.802728:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9ba98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9660 expref: 15 pid: 6509 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.802747:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859116928:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873848.802775:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.802787:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.802793:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.803096:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.803113:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.803124:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.803166:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.803184:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.803379:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859117056:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873848.803460:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873848.825883:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859117056:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873848.825922:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873848.826911:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873848.827430:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840158336 00000100:00100000:3.0:1788873848.827444:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840158336 00010000:00010000:3.0:1788873848.827500:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 16 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873848.827564:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:3.0:1788873848.827587:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+16:2400:x1875769840158336:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873848.827606:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873848.827615:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 16 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.827632:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 16 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.827662:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9bc19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96c2 expref: 16 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.827681:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:3.0:1788873848.827687:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.827698:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.827723:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.827753:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873848.827942:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873848.827958:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873848.828132:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788873848.828498:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788873848.828542:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788873848.828665:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859117184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788873848.828752:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873848.828921:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442568f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788873848.829006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859117184 00000100:00100000:0.0:1788873848.829015:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859117184 00000100:00100000:0.0:1788873848.829066:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788873848.829141:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1875769859117184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788873848.829353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1875769859117184:12345-0@lo:1000:mdt00_001.0 Request processed in 277us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873848.829361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788873848.829419:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788873848.829426:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343bc0000, transno 4294967302 00000100:00100000:0.0:1788873848.829443:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451803100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859117184:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788873848.829712:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2400:x1875769840158336:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 2132us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873848.829724:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 63 00000001:00080000:0.0:1788873848.832456:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788873848.833787:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859117312:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788873848.833903:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873848.834413:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442568e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873848.839521:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859117312 00000100:00100000:1.0:1788873848.839546:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859117312 00000100:00100000:1.0:1788873848.840939:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788873848.841383:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875769859117312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788873848.841708:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1875769859117312:12345-0@lo:1000:mdt00_001.0 Request processed in 754us (7804us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788873848.841718:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788873848.842395:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859117312:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788873848.842482:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842495:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842505:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842513:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873848.842519:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842543:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842565:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:2.0:1788873848.842569:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788873848.842577:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842584:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9bc5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842628:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842635:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842641:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842646:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873848.842649:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842655:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842663:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:2.0:1788873848.842666:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788873848.842669:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842686:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bb8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842718:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842737:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842747:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842792:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.842828:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 18 pid: 8450 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873848.842846:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859117440:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873848.844781:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873848.849519:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873848.849561:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840158464 00000100:00100000:1.0:1788873848.849573:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840158464 00010000:00010000:1.0:1788873848.849629:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 19 pid: 8450 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873848.849674:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:1.0:1788873848.849685:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+19:2400:x1875769840158464:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873848.849705:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788873848.849707:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859117440:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873848.849720:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 19 pid: 8450 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.849733:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 19 pid: 8450 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.849764:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.849882:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96a6 expref: 19 pid: 8450 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.849904:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:1.0:1788873848.849911:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.849923:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.849933:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873848.850037:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873848.850278:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850286:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850301:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850318:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850325:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850332:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.850338:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873848.850338:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2400:x1875769840158464:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 653us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873848.850347:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 64 00010000:00010000:3.0:1788873848.850360:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850370:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873848.850373:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873848.850377:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850384:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bc66 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850397:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850403:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850409:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850414:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873848.850417:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850424:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850432:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873848.850435:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788873848.850438:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.850453:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bc58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873848.852514:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788873848.852527:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788873848.852551:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788873848.852558:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788873848.857656:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+17:11301:x1875769840158080:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 60533us (62006us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788873848.857682:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 93 00000020:00080000:3.0:1788873848.857694:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788873848.863166:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873848.865478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840158720 00000100:00100000:2.0:1788873848.865506:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840158720 00000100:00100000:2.0:1788873848.865630:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:2.0:1788873848.865646:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+17:11301:x1875769840158720:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788873848.866124:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788873848.866171:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788873848.866296:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.866333:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.866349:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.866361:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.866368:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.866375:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873848.866412:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788873848.866498:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873848.866509:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.866518:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873848.866525:0:10332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.866535:0:10332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873848.866541:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11301:x1875769840158720:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 892us (3385us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788873848.866553:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00010000:00010000:3.0:1788873848.866554:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:3.0:1788873848.866559:0:10332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:2.0:1788873848.866561:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788873848.866566:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.866573:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bc6d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873848.866589:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873848.866593:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873848.866595:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873848.901944:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873848.901960:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873848.901994:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788873848.902002:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788873848.948435:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873849.136679:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.137757:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840158976 00000100:00100000:0.0:1788873849.137776:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840158976 00000100:00100000:0.0:1788873849.137887:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 94 00000100:00100000:0.0:1788873849.137900:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11311:x1875769840158976:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873849.137936:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873849.137964:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bc74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96de expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.138115:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bc7b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.138147:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bc7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.138165:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bc7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873849.138181:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788873849.138360:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bc74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96de expref: 22 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788873849.138361:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788873849.138384:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bc7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96de expref: 21 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.138396:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873849.138400:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788873849.138404:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93600, rc 0) 00000100:00100000:0.0:1788873849.138496:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11311:x1875769840158976:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 596us (1834us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788873849.138504:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 94 00000100:00100000:3.0:1788873849.140967:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.141475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840159104 00000100:00100000:0.0:1788873849.141490:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840159104 00000100:00100000:0.0:1788873849.141564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 95 00000100:00100000:0.0:1788873849.141577:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11311:x1875769840159104:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:0.0:1788873849.141708:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141734:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141764:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141784:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141791:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141800:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141908:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141917:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.141923:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873849.141997:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142015:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142022:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142029:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142045:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.142052:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142061:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142077:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873849.142080:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.142087:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142093:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bc89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142106:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142112:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142119:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142125:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.142128:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142135:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142155:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc800) 00010000:00010000:0.0:1788873849.142157:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.142160:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142166:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bc90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142182:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142189:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142194:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142199:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.142201:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142233:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142240:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d33410dc200) 00010000:00010000:0.0:1788873849.142242:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.142245:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.142251:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bc97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.142373:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11311:x1875769840159104:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 798us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.142382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 95 00000100:00100000:1.0:1788873849.207737:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.209626:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840159360 00000100:00100000:2.0:1788873849.209647:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840159360 00000100:00100000:2.0:1788873849.209777:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 96 00000100:00100000:2.0:1788873849.209789:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11314:x1875769840159360:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873849.209855:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.209883:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bc9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96e5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.209996:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210016:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210032:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210052:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210059:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210067:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210275:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210284:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210292:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873849.210314:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788873849.210430:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210440:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210448:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210456:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873849.210462:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210472:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210490:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873849.210494:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873849.210502:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210509:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bca5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210527:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210533:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210539:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210544:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440031000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873849.210554:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210561:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210569:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d3446399000) 00010000:00010000:2.0:1788873849.210572:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873849.210576:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210582:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bcac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210632:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bc9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210648:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.210657:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.210660:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873849.210663:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030600, rc 0) 00000100:00100000:2.0:1788873849.210760:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+23:11314:x1875769840159360:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 972us (3042us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788873849.210769:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 96 00000100:00100000:3.0:1788873849.217467:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.217604:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840159488 00000100:00100000:0.0:1788873849.217617:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840159488 00000100:00100000:0.0:1788873849.217702:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 97 00000100:00100000:0.0:1788873849.217715:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+23:11314:x1875769840159488:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:0.0:1788873849.217816:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217840:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217857:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217898:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217904:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217909:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217912:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.217916:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217922:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217953:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:0.0:1788873849.217955:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788873849.217961:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.217966:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bcc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.218054:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+23:11314:x1875769840159488:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 341us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.218061:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 97 00000100:00100000:1.0:1788873849.221869:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.222008:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840159744 00000100:00100000:2.0:1788873849.222023:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840159744 00000100:00100000:2.0:1788873849.222374:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:2.0:1788873849.222389:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+23:11314:x1875769840159744:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873849.222725:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+24:11314:x1875769840159744:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 338us (933us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788873849.222734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:0.0:1788873849.266363:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.269299:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160000 00000100:00100000:2.0:1788873849.269352:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160000 00000100:00100000:2.0:1788873849.269467:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 98 00000100:00100000:2.0:1788873849.269481:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+24:10840:x1875769840160000:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873849.269516:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.269548:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bcc8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96ec expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.269716:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.269737:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.269747:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.270436:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.270464:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 25 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873849.270485:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859117568:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873849.270706:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753480 going to sleep for 11 seconds 00000100:00100000:3.0:1788873849.275170:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.275427:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160128 00000100:00100000:0.0:1788873849.275441:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160128 00010000:00010000:0.0:1788873849.275499:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 26 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.275561:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:0.0:1788873849.275575:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+26:2400:x1875769840160128:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873849.275594:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873849.275602:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 26 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.275631:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 26 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.275662:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:0.0:1788873849.275685:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.275698:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.275708:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.275735:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873849.275824:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+26:2400:x1875769840160128:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 251us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.275834:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 65 00010000:00010000:2.0:1788873849.280417:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bcb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96e5 expref: 25 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873849.280457:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859117568:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873849.280491:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.280505:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.280513:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873849.280542:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788873849.281176:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bcc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.281201:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.281416:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.281420:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788873849.281425:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440031000, rc 0) 00000100:00100000:2.0:1788873849.281516:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+25:10840:x1875769840160000:12345-192.168.202.20@tcp:101:bash.0 Request processed in 12036us (15171us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788873849.281527:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 98 00000100:00100000:1.0:1788873849.287366:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.287549:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160256 00000100:00100000:2.0:1788873849.287581:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160256 00000100:00100000:2.0:1788873849.287669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 99 00000100:00100000:2.0:1788873849.287683:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+25:10840:x1875769840160256:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873849.287715:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.287747:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bcdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96f3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.287796:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bce4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.287814:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.287829:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.287979:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bcdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96f3 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.288004:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bce4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96f3 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.288015:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.288018:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788873849.288023:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030400, rc 0) 00000100:00100000:2.0:1788873849.288111:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+26:10840:x1875769840160256:12345-192.168.202.20@tcp:101:bash.0 Request processed in 431us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873849.288119:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 99 00000100:00100000:1.0:1788873849.291747:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.292679:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160512 00000100:00100000:2.0:1788873849.292716:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160512 00000100:00100000:2.0:1788873849.292863:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 100 00000100:00100000:2.0:1788873849.292876:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+26:10840:x1875769840160512:12345-192.168.202.20@tcp:36:bash.0 00010000:00010000:2.0:1788873849.293241:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.293264:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.293279:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788873849.293348:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788873849.293374:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000301d0ff4 reply state 00000000e1760d56 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.293389:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.293397:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.293400:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788873849.293404:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788873849.293445:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788873849.293564:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+30:10840:x1875769840160512:12345-192.168.202.20@tcp:36:bash.0 Request processed in 689us (1833us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788873849.293574:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 100 00000020:00080000:2.0:1788873849.293580:0:8450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788873849.297320:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.297492:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160640 00000100:00100000:2.0:1788873849.297507:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160640 00000100:00100000:2.0:1788873849.297592:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 101 00000100:00100000:2.0:1788873849.297605:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+30:10840:x1875769840160640:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873849.297670:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.297701:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bcf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a96fa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.297785:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bcf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96fa expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.297819:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bcf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96fa expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.297846:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.297849:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788873849.297854:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030c00, rc 0) 00000100:00100000:2.0:1788873849.297946:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+31:10840:x1875769840160640:12345-192.168.202.20@tcp:101:bash.0 Request processed in 343us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873849.297953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 101 00000100:00100000:1.0:1788873849.302174:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.302461:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160768 00000100:00100000:2.0:1788873849.302475:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160768 00000100:00100000:2.0:1788873849.302588:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:2.0:1788873849.302600:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:10840:x1875769840160768:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873849.302635:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.302664:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9701 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873849.302698:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa00c78, atime: 0x6aa00c76, ctime: 0x6aa00c78, blocks: 0x8 00010000:00010000:2.0:1788873849.302729:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788873849.302735:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873849.302765:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.302804:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.302823:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030000, rc 0) 00000100:00100000:2.0:1788873849.302902:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:10840:x1875769840160768:12345-192.168.202.20@tcp:101:bash.0 Request processed in 303us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873849.302909:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:3.0:1788873849.305440:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.305763:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840160896 00000100:00100000:0.0:1788873849.305779:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840160896 00002000:00010000:0.0:1788873849.305855:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788873849.305861:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f4cf480 with x1875769840160896 ext(0->18446744073709551615) 00002000:00010000:0.0:1788873849.305881:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d347f4cf480. 00000100:00100000:0.0:1788873849.305920:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:0.0:1788873849.305932:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840160896:12345-192.168.202.20@tcp:10:bash.0 00002000:00010000:0.0:1788873849.306383:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788873849.306388:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788873848 -> 1788873850 00002000:00010000:0.0:1788873849.306391:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788873846 -> 1788873846 00002000:00010000:0.0:1788873849.306393:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788873848 -> 1788873850 00002000:00010000:0.0:1788873849.306395:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788873849.306484:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840160896:12345-192.168.202.20@tcp:10:bash.0 Request processed in 552us (1059us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788873849.306494:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 1 00002000:00010000:0.0:1788873849.306513:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788873849.306516:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f4cf480 with x1875769840160896 ext(0->18446744073709551615) 00002000:00010000:0.0:1788873849.306521:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d347f4cf480. 00000100:00100000:3.0:1788873849.423843:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.424719:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840161024 00000100:00100000:1.0:1788873849.424738:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840161024 00000100:00100000:1.0:1788873849.424952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 102 00000100:00100000:1.0:1788873849.424967:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+31:11327:x1875769840161024:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:1.0:1788873849.425171:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425193:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425366:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425391:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425401:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425409:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425523:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425534:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425540:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873849.425710:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425727:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425734:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425742:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425749:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873849.425754:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425763:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425778:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:1.0:1788873849.425781:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873849.425788:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425912:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425930:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425936:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425949:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425954:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873849.425957:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425965:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.425974:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd400) 00010000:00010000:1.0:1788873849.426051:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873849.426056:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426064:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bd07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426082:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426089:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426094:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426099:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873849.426102:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426119:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426128:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:1.0:1788873849.426131:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873849.426135:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.426141:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bd0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873849.426513:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+31:11327:x1875769840161024:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 1544us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.426525:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 102 00000100:00100000:0.0:1788873849.478049:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.478246:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840161280 00000100:00100000:2.0:1788873849.478260:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840161280 00000100:00100000:2.0:1788873849.478355:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 103 00000100:00100000:2.0:1788873849.478369:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+31:11331:x1875769840161280:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873849.478399:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.478432:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bd15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9708 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478542:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478562:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478578:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478648:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478679:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478688:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478848:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478859:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.478867:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873849.478880:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788873849.479000:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479010:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479018:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479023:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873849.479029:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479038:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479064:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873849.479067:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873849.479074:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479082:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bd1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479102:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479108:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479114:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479120:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215f800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873849.479123:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479130:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479138:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d3446399c00) 00010000:00010000:2.0:1788873849.479141:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873849.479144:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479150:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479293:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bd15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9708 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479322:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9708 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.479331:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.479333:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788873849.479336:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ee00, rc 0) 00000100:00100000:2.0:1788873849.479422:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+33:11331:x1875769840161280:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1055us (1392us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788873849.479431:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 103 00000100:00100000:3.0:1788873849.486921:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.488125:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840161408 00000100:00100000:2.0:1788873849.488144:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840161408 00000100:00100000:2.0:1788873849.488261:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 104 00000100:00100000:2.0:1788873849.488274:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+33:11331:x1875769840161408:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:2.0:1788873849.488387:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.488412:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.488424:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.488471:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.488511:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 33 pid: 6512 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873849.488529:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859117696:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873849.488972:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873849.493090:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.493275:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859117696:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873849.493330:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873849.493593:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840161664 00000100:00100000:1.0:1788873849.493603:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840161664 00000100:00100000:1.0:1788873849.493693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:1.0:1788873849.493705:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+34:6172:x1875769840161664:12345-192.168.202.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788873849.494140:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+35:6172:x1875769840161664:12345-192.168.202.20@tcp:35:ldlm_bl.0 Request processed in 434us (1065us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788873849.494150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:1.0:1788873849.497958:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.498423:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840161792 00000100:00100000:2.0:1788873849.498437:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840161792 00010000:00010000:2.0:1788873849.498497:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 35 pid: 6512 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873849.498591:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:2.0:1788873849.498617:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+35:2401:x1875769840161792:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873849.498639:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873849.498648:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 35 pid: 6512 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.498665:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 35 pid: 6512 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.498697:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bccf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a96ec expref: 35 pid: 6512 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.498752:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.498759:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.498771:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.498781:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.499081:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873849.499292:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+34:2401:x1875769840161792:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 685us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873849.499311:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 66 00010000:00010000:3.0:1788873849.499523:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499535:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499590:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499598:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499617:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499624:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215f800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873849.499630:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499640:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499654:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:3.0:1788873849.499669:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873849.499674:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.499681:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873849.499742:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+33:11331:x1875769840161408:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 11470us (12841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873849.499751:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 104 00000100:00100000:0.0:1788873849.503499:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.503707:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840162048 00000100:00100000:2.0:1788873849.503722:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840162048 00000100:00100000:2.0:1788873849.503908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:2.0:1788873849.503922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+33:11331:x1875769840162048:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873849.504560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+34:11331:x1875769840162048:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 637us (1074us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788873849.504572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:0.0:1788873849.567155:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.567306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840162304 00000100:00100000:1.0:1788873849.567321:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840162304 00000100:00100000:1.0:1788873849.567409:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 105 00000100:00100000:1.0:1788873849.567421:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+34:11342:x1875769840162304:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:1.0:1788873849.567454:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873849.567504:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a970f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567685:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567706:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567723:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567744:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567752:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567759:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567919:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bd54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567930:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bd54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.567938:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bd54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873849.567951:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788873849.568051:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568071:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568079:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568086:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecac00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873849.568091:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568100:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568118:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:1.0:1788873849.568122:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873849.568128:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568135:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bd46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568152:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568159:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568165:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568171:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873849.568181:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568188:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.568197:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dd400) 00010000:00010000:1.0:1788873849.568200:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873849.569058:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.569075:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bd4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.569156:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9bd3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a970f expref: 37 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.569174:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bd54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a970f expref: 36 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.569185:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:1.0:1788873849.569188:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873849.569191:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecae00, rc 0) 00000100:00100000:1.0:1788873849.569326:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3451803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+36:11342:x1875769840162304:12345-192.168.202.20@tcp:101:cat.0 Request processed in 1906us (2183us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788873849.569336:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 105 00000100:00100000:1.0:1788873849.575668:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.575759:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840162560 00000100:00100000:0.0:1788873849.575774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840162560 00000100:00100000:0.0:1788873849.575926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:0.0:1788873849.575938:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+36:11342:x1875769840162560:12345-192.168.202.20@tcp:35:cat.0 00000100:00100000:0.0:1788873849.576655:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+37:11342:x1875769840162560:12345-192.168.202.20@tcp:35:cat.0 Request processed in 713us (997us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788873849.576664:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:3.0:1788873849.583157:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859117824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873849.583328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873849.583531:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859117824 00000100:00100000:1.0:1788873849.583543:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859117824 00000100:00100000:1.0:1788873849.583624:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788873849.583655:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859117824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873849.583705:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788873849.583782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859117824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.583790:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788873849.584021:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859117824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873849.595995:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.596179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840162816 00000100:00100000:0.0:1788873849.596191:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840162816 00000100:00100000:0.0:1788873849.596384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 106 00000100:00100000:0.0:1788873849.596398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+37:11343:x1875769840162816:12345-192.168.202.20@tcp:36:rm.0 00010000:00010000:0.0:1788873849.596490:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788873849.596530:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bcf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96fa expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596557:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bd54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a970f expref: 36 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596570:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9708 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596612:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9bce4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96f3 expref: 34 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596623:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:0.0:1788873849.596630:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873849.596663:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596680:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596691:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596714:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.596720:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597122:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597132:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597140:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873849.597696:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788873849.597712:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386543506578ns, next at 387543502232ns, rc = 0 00010000:00010000:0.0:1788873849.597788:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597814:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597823:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597831:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597840:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597847:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597944:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788873849.597983:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597991:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.597998:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598005:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.598023:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598032:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598045:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:0.0:1788873849.598048:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788873849.598055:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598062:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bd70 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598087:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598093:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598099:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598104:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.598107:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598114:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598121:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873849.598124:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.598134:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598140:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bd62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873849.598151:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030c890db reply state 000000007de8d886 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598165:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.598171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:0.0:1788873849.598174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873849.598177:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873849.598354:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11343:x1875769840162816:12345-192.168.202.20@tcp:36:rm.0 Request processed in 1954us (2380us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788873849.598366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 106 00010000:00010000:2.0:1788873849.600138:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873849.600158:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.600173:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873849.600178:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.600326:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.600351:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:2.0:1788873849.600354:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788873849.600361:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.600369:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9bd77 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.600389:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873849.600392:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873849.600394:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873849.635160:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.635455:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840163072 00000100:00100000:2.0:1788873849.635469:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840163072 00000100:00100000:2.0:1788873849.635538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 107 00000100:00100000:2.0:1788873849.635551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11349:x1875769840163072:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873849.635585:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.635627:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bd7e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9716 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.635777:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.635806:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.635822:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.635864:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.635872:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.635879:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873849.636400:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788873849.636542:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636551:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636556:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636585:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636591:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636596:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636600:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873849.636603:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636622:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636645:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873849.636648:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873849.636652:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636657:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bd85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788873849.636669:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2911480 reply state 0000000001c9d8fc transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636678:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636682:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:2.0:1788873849.636684:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788873849.636686:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788873849.636717:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9bd7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636728:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 37 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.636733:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:2.0:1788873849.636735:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873849.636736:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873849.636815:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11349:x1875769840163072:12345-192.168.202.20@tcp:101:bash.0 Request processed in 1267us (1671us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788873849.636831:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 107 00000100:00100000:3.0:1788873849.642882:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.642999:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840163200 00000100:00100000:2.0:1788873849.643014:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840163200 00000100:00100000:2.0:1788873849.644724:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:2.0:1788873849.644749:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840163200:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873849.644775:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873849.644814:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a971d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873849.644848:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788873849.644877:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788873849.644882:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873849.644894:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.644919:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873849.644932:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030400, rc 0) 00000100:00100000:2.0:1788873849.645017:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840163200:12345-192.168.202.20@tcp:101:bash.0 Request processed in 275us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873849.645025:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00080000:3.0:1788873849.647013:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873849.648417:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.648577:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840163328 00000100:00100000:1.0:1788873849.648588:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840163328 00000100:00100000:1.0:1788873849.648656:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:1.0:1788873849.648665:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:11349:x1875769840163328:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:1.0:1788873849.648686:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873849.648711:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9724 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.648743:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.648751:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873849.648754:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873849.648759:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.648797:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.648953:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 9 pid: 8425 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873849.648989:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875769859117952:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788873849.649249:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873849.652606:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873849.652711:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840163456 00000100:00100000:3.0:1788873849.652723:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840163456 00000100:00100000:1.0:1788873849.652751:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875769859117952:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873849.652773:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 10 pid: 8425 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.652787:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873849.652838:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:3.0:1788873849.652850:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2401:x1875769840163456:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873849.652870:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873849.652875:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecba00, rc 0) 00010000:00010000:3.0:1788873849.652898:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 10 pid: 8425 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.652920:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 10 pid: 8425 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.652950:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27e2872/0x25c660afb0a9bda1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a971d expref: 10 pid: 8425 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873849.652955:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+10:11349:x1875769840163328:12345-192.168.202.20@tcp:101:bash.0 Request processed in 4290us (4555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.652962:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 43 00010000:00010000:3.0:1788873849.652969:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873849.652985:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873849.652995:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.653008:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.653050:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873849.653066:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f437b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875769859118080:192.168.202.20@tcp:105: 00000100:00100000:3.0:1788873849.653131:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788873849.656648:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f437b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875769859118080:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788873849.656686:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873849.656768:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840163456:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 3918us (4175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.656782:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:2.0:1788873849.661511:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.662003:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840163712 00000100:00100000:1.0:1788873849.662018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840163712 00000100:00100000:1.0:1788873849.662100:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:1.0:1788873849.662112:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+38:11349:x1875769840163712:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:1.0:1788873849.662540:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+39:11349:x1875769840163712:12345-192.168.202.20@tcp:35:bash.0 Request processed in 428us (1043us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788873849.662548:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:3.0:1788873849.811515:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.811648:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840163840 00000100:00100000:1.0:1788873849.811661:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840163840 00000100:00100000:1.0:1788873849.811746:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 108 00000100:00100000:1.0:1788873849.811758:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+39:11365:x1875769840163840:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788873849.811791:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873849.811837:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bdaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a972b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.811953:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bdb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.811972:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.811986:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873849.812049:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788873849.812054:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873849.812425:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.812459:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9bdaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a972b expref: 41 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.812481:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a972b expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.812491:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:1.0:1788873849.812494:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873849.812498:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecac00, rc 0) 00000100:00100000:1.0:1788873849.812581:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+40:11365:x1875769840163840:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 825us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.812588:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 108 00000100:00100000:3.0:1788873849.815994:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.816552:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840164096 00000100:00100000:0.0:1788873849.816567:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840164096 00000100:00100000:0.0:1788873849.816654:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 109 00000100:00100000:0.0:1788873849.816668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+40:11365:x1875769840164096:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873849.816700:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873849.816751:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9732 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.816907:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bdc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.816923:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.816937:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873849.816949:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788873849.817157:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9732 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.817180:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9732 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.817190:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:0.0:1788873849.817193:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873849.817197:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92400, rc 0) 00000100:00100000:0.0:1788873849.817388:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+42:11365:x1875769840164096:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 722us (1407us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788873849.817396:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 109 00000100:00100000:2.0:1788873849.821467:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873849.821774:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840164352 00000100:00100000:3.0:1788873849.821800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840164352 00000100:00100000:3.0:1788873849.821921:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 110 00000100:00100000:3.0:1788873849.821936:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+42:11365:x1875769840164352:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873849.822003:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873849.822033:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bdd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9739 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.822516:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bdd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.822536:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.822551:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bdd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873849.822565:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788873849.822701:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bdd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9739 expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.822721:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bdd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9739 expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.822731:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:3.0:1788873849.822734:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788873849.822738:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443200, rc 0) 00000100:00100000:3.0:1788873849.822922:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+44:11365:x1875769840164352:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 988us (1469us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788873849.822931:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 110 00000100:00100000:3.0:1788873849.826256:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.826536:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840164480 00000100:00100000:1.0:1788873849.826550:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840164480 00000100:00100000:1.0:1788873849.826661:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:1.0:1788873849.826674:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+44:2401:x1875769840164480:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873849.826697:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873849.826731:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9bdc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9732 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.826755:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:1.0:1788873849.826761:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873849.826844:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+43:2401:x1875769840164480:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 173us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.826853:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:1.0:1788873849.831092:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.831240:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840164608 00000100:00100000:0.0:1788873849.831255:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840164608 00000100:00100000:0.0:1788873849.831343:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:0.0:1788873849.831356:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840164608:12345-192.168.202.20@tcp:1:lfs.0 00010000:00010000:0.0:1788873849.831441:0:8789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.831467:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.831475:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873849.831480:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873849.831485:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.831531:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.831547:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 8 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.831564:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8789:1875769859118208:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873849.831685:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873849.834492:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.834592:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840164736 00000100:00100000:1.0:1788873849.834615:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840164736 00000100:00100000:0.0:1788873849.834622:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8789:1875769859118208:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873849.834657:0:8789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788873849.834675:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d347f434380 x1875769840164736/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:265/0 lens 504/0 e 0 to 0 dl 1788873860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873849.834685:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f434380 with x1875769840164736 ext(0->8) 00010000:00010000:1.0:1788873849.834693:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 9 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.834709:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 9 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788873849.834717:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d347f434380 00000100:00100000:1.0:1788873849.834759:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:1.0:1788873849.834771:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840164736:12345-192.168.202.20@tcp:4:lfs.0 00000100:00100000:1.0:1788873849.839905:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2400:x1875769840164736:12345-192.168.202.20@tcp:4:lfs.0 Request processed in 5125us (5414us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788873849.839922:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 1 00002000:00100000:1.0:1788873849.839936:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d347f434380 x1875769840164736/t4294967303(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:265/0 lens 504/448 e 0 to 0 dl 1788873860 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873849.839946:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f434380 with x1875769840164736 ext(0->8) 00010000:00010000:1.0:1788873849.839957:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 11 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.839981:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 11 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788873849.839990:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d347f434380 00000100:00100000:3.0:1788873849.842501:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.842749:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840164864 00000100:00100000:0.0:1788873849.842766:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840164864 00010000:00010000:0.0:1788873849.842817:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 11 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.842891:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:0.0:1788873849.842901:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458494850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2400:x1875769840164864:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873849.842915:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788873849.842934:0:9516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788873849.842937:0:9516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788873850 00002000:00010000:0.0:1788873849.842939:0:9516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788873850 00002000:00010000:0.0:1788873849.842941:0:9516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788873850 00002000:00010000:0.0:1788873849.842943:0:9516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788873849.842949:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 11 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.842963:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 11 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.842987:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9bda8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9724 expref: 11 pid: 8424 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.843005:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873849.843009:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873849.843015:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.843024:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.843077:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873849.843144:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458494850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2400:x1875769840164864:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 243us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.843152:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 68 00010000:00010000:1.0:1788873849.843553:0:8789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843710:0:8789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843731:0:8789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843739:0:8789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843759:0:8789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843767:0:8789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788873849.843772:0:8789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843782:0:8789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843798:0:8789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.843806:0:8789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7327a6/0x25c660afb0a9bde7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873849.843856:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840164608:12345-192.168.202.20@tcp:1:lfs.0 Request processed in 12502us (12789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.843864:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:3.0:1788873849.846147:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.846951:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840165120 00000100:00100000:0.0:1788873849.846965:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840165120 00000100:00100000:0.0:1788873849.847031:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:0.0:1788873849.847041:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+43:11365:x1875769840165120:12345-192.168.202.20@tcp:35:lfs.0 00000004:00010000:0.0:1788873849.847106:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bdd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9739 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873849.848130:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788873849.848171:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788873849.848602:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788873849.848642:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.848660:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.848670:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.848708:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.848724:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 47 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.848745:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f419500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875769859118336:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873849.848835:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873849.852356:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.852460:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840165248 00000100:00100000:1.0:1788873849.852470:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840165248 00010000:00010000:1.0:1788873849.852525:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 48 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873849.852768:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:1.0:1788873849.852784:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+48:2401:x1875769840165248:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873849.852798:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873849.852806:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 48 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.852819:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 48 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.852841:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:1.0:1788873849.852846:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.852857:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.852864:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.852881:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873849.852933:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+48:2401:x1875769840165248:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 151us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.853764:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 69 00010000:00010000:0.0:1788873849.854125:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bd93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9716 expref: 47 pid: 6511 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.854146:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f419500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875769859118336:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873849.854169:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.854179:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.854184:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873849.854342:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788873849.854456:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788873849.854615:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f419500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859118464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788873849.854672:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873849.854697:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873849.854952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859118464 00000100:00100000:1.0:1788873849.854959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859118464 00000100:00100000:1.0:1788873849.855003:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788873849.855012:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1875769859118464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788873849.855097:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1875769859118464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.855118:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788873849.855196:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f419500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859118464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788873849.855353:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788873849.855397:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859118592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788873849.855428:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873849.855454:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873849.856457:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859118592 00000100:00100000:1.0:1788873849.856465:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859118592 00000100:00100000:1.0:1788873849.856530:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788873849.856539:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1875769859118592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788873849.856697:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6513:x1875769859118592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (1267us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788873849.856705:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788873849.856869:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859118592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788873849.856925:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788873849.856962:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.856972:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.856979:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.856985:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873849.856990:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.856999:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.857014:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:3.0:1788873849.857017:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788873849.857021:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.857027:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bdee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788873849.857132:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788873849.857198:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788873849.857248:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386803042788ns, next at 387803040531ns, rc = 0 00000001:00080000:3.0:1788873849.857254:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788873849.857291:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d3446399c00) 00010000:00010000:3.0:1788873849.857305:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788873849.857312:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bdd9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9739 expref: 51 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873849.857401:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+50:11365:x1875769840165120:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 10361us (11269us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788873849.857409:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 26 00000020:00080000:3.0:1788873849.857413:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788873849.859782:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873849.859922:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840165376 00000100:00100000:1.0:1788873849.859941:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840165376 00000100:00100000:1.0:1788873849.860000:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 111 00000100:00100000:1.0:1788873849.860010:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+50:11365:x1875769840165376:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788873849.860031:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873849.860052:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bdf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9740 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.860106:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bdf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9740 expref: 51 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.860121:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bdf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9740 expref: 51 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873849.860140:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:1.0:1788873849.860143:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788873849.860147:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb000, rc 0) 00000100:00100000:1.0:1788873849.860618:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+51:11365:x1875769840165376:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 193us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873849.860650:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 111 00000100:00100000:1.0:1788873849.863798:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873849.863884:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840165632 00000100:00100000:2.0:1788873849.863894:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840165632 00000100:00100000:2.0:1788873849.863957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:2.0:1788873849.863969:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+51:11365:x1875769840165632:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873849.864194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11365:x1875769840165632:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 227us (405us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788873849.864227:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:3.0:1788873849.955757:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.956101:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840165760 00000100:00100000:0.0:1788873849.956116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840165760 00000100:00100000:0.0:1788873849.956240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 112 00000100:00100000:0.0:1788873849.956254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11375:x1875769840165760:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:0.0:1788873849.956380:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956425:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956439:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956453:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956461:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956467:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956569:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956576:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956583:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873849.956648:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956663:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956671:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956689:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956696:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.956701:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956710:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956723:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873849.956726:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.956732:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956739:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9bdfc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956755:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956762:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956767:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.956772:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.956775:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957194:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957310:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:0.0:1788873849.957313:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.957318:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957324:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957336:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957342:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957347:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957353:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.957356:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957362:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957369:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873849.957372:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873849.957374:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.957391:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.957497:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11375:x1875769840165760:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 1244us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.957506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 112 00010000:00010000:0.0:1788873849.967402:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873849.991142:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873849.991318:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840166016 00000100:00100000:3.0:1788873849.991332:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840166016 00000100:00100000:3.0:1788873849.991413:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 113 00000100:00100000:3.0:1788873849.991425:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+52:11378:x1875769840166016:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873849.991452:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873849.991481:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9747 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991618:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991638:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991653:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991667:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991687:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991695:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991888:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991897:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.991904:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873849.991916:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788873849.992029:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992037:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992045:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992050:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873849.992056:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992064:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992091:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:3.0:1788873849.992094:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873849.992100:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992107:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9be18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992124:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992130:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992136:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992142:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873849.992144:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992150:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992156:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:3.0:1788873849.992158:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873849.992162:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992167:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9be1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992316:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992333:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873849.992341:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:3.0:1788873849.992344:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873849.992346:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873849.992437:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11378:x1875769840166016:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1013us (1309us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788873849.992447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 113 00000100:00100000:1.0:1788873849.996364:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873849.996522:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840166144 00000100:00100000:0.0:1788873849.996536:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840166144 00000100:00100000:0.0:1788873849.996609:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:0.0:1788873849.996622:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11378:x1875769840166144:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:0.0:1788873849.996713:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996736:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996752:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996815:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996823:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996830:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996858:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873849.996863:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996872:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996887:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873849.996891:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788873849.996897:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873849.996905:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873849.997232:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11378:x1875769840166144:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 611us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873849.997241:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:1.0:1788873850.000536:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873850.000613:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840166400 00000100:00100000:3.0:1788873850.000626:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840166400 00000100:00100000:3.0:1788873850.000696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 28 00000100:00100000:3.0:1788873850.000709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:11378:x1875769840166400:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873850.001036:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+55:11378:x1875769840166400:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 328us (511us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788873850.001044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 28 00000100:00100000:2.0:1788873850.066378:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.066497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840166656 00000100:00100000:0.0:1788873850.066514:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840166656 00000100:00100000:0.0:1788873850.066606:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 115 00000100:00100000:0.0:1788873850.066620:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+55:11388:x1875769840166656:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873850.066657:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873850.066661:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788873850.066709:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9bdb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a972b expref: 55 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.066735:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873850.066764:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873850.066802:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a974e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.066965:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.066993:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.067003:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.067054:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.067073:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 55 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873850.067092:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f41b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859118720:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873850.067281:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788873850.071853:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f41b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859118720:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873850.071894:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873850.072963:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.073056:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840166784 00000100:00100000:0.0:1788873850.073067:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840166784 00010000:00010000:0.0:1788873850.073120:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 56 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873850.073194:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 70 00000100:00100000:0.0:1788873850.073230:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+56:2400:x1875769840166784:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873850.073251:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873850.073259:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 56 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.073273:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 56 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.073315:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9be26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9747 expref: 56 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.073336:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.073343:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.073356:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.073368:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.073408:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873850.073485:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+55:2400:x1875769840166784:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 280us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.073493:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 70 00010000:00010000:2.0:1788873850.073572:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.073580:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873850.073607:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788873850.073789:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9be3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.073806:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.073827:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873850.073830:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788873850.073833:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92400, rc 0) 00000100:00100000:2.0:1788873850.073862:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+55:11388:x1875769840166656:12345-192.168.202.20@tcp:101:bash.0 Request processed in 7246us (7502us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788873850.073869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 115 00000100:00100000:1.0:1788873850.077477:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873850.077585:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840166912 00000100:00100000:2.0:1788873850.077601:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840166912 00000100:00100000:2.0:1788873850.077681:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 116 00000100:00100000:2.0:1788873850.077695:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+55:11388:x1875769840166912:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873850.077727:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873850.077756:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9be50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9755 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.077815:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.077833:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.077848:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.078024:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9be50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 57 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.078047:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 56 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.078066:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873850.078069:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788873850.078074:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030400, rc 0) 00000100:00100000:2.0:1788873850.078163:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+56:11388:x1875769840166912:12345-192.168.202.20@tcp:101:bash.0 Request processed in 470us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873850.078170:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 116 00000100:00100000:1.0:1788873850.080928:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873850.081043:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840167168 00000100:00100000:3.0:1788873850.081057:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840167168 00000100:00100000:3.0:1788873850.081136:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 117 00000100:00100000:3.0:1788873850.081149:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+56:11388:x1875769840167168:12345-192.168.202.20@tcp:36:bash.0 00010000:00010000:3.0:1788873850.081519:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.081562:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.081578:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788873850.081635:0:8993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788873850.081658:0:8993:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3abc3a3 reply state 00000000edde365c transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.081673:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.081681:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:3.0:1788873850.081684:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788873850.081689:0:8993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788873850.081791:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11388:x1875769840167168:12345-192.168.202.20@tcp:36:bash.0 Request processed in 644us (876us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788873850.081799:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 117 00000020:00080000:3.0:1788873850.081805:0:8993:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788873850.085086:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873850.085635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840167296 00000100:00100000:2.0:1788873850.085652:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840167296 00000100:00100000:2.0:1788873850.085777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 118 00000100:00100000:2.0:1788873850.085948:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11388:x1875769840167296:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873850.085987:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873850.086018:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a975c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.086153:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.086172:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.086183:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.086251:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.086268:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 60 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873850.086314:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859118848:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873850.086495:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753480 going to sleep for 11 seconds 00000100:00100000:2.0:1788873850.089662:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859118848:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873850.089702:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873850.090847:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873850.091098:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840167424 00000100:00100000:2.0:1788873850.091111:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840167424 00010000:00010000:2.0:1788873850.091162:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 61 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873850.091255:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 71 00000100:00100000:2.0:1788873850.091267:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+61:2401:x1875769840167424:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873850.091285:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873850.091305:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 61 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.091320:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 61 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.091350:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a974e expref: 61 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.091376:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873850.091382:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.091417:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.091426:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.091458:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873850.091526:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:2401:x1875769840167424:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 260us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873850.091534:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 71 00010000:00010000:3.0:1788873850.091768:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.091778:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873850.091871:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788873850.091878:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873850.091919:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.091959:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.091981:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873850.091990:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:3.0:1788873850.091994:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873850.091998:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030c00, rc 0) 00000100:00100000:3.0:1788873850.092033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11388:x1875769840167296:12345-192.168.202.20@tcp:101:bash.0 Request processed in 6093us (6964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873850.092040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 118 00000100:00100000:1.0:1788873850.095885:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873850.096552:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840167680 00000100:00100000:3.0:1788873850.096570:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840167680 00000100:00100000:3.0:1788873850.096693:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:3.0:1788873850.096708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:11388:x1875769840167680:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:3.0:1788873850.097333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11388:x1875769840167680:12345-192.168.202.20@tcp:35:bash.0 Request processed in 625us (1461us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788873850.097343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:1.0:1788873850.156688:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.156935:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840167808 00000100:00100000:0.0:1788873850.156963:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840167808 00000100:00100000:0.0:1788873850.157043:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 119 00000100:00100000:0.0:1788873850.157057:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:11394:x1875769840167808:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873850.157092:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873850.157122:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9be73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9763 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.157252:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9be7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.157270:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9be7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.157284:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9be7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873850.157355:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788873850.157360:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873850.157384:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9be7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.157413:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9be73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9763 expref: 62 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.157436:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9be7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9763 expref: 61 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.157445:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873850.157448:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788873850.157453:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92a00, rc 0) 00000100:00100000:0.0:1788873850.157641:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840167808:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 587us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.157649:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 119 00000100:00100000:0.0:1788873850.161531:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873850.161671:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840167936 00000100:00100000:2.0:1788873850.161686:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840167936 00000100:00100000:2.0:1788873850.161801:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 120 00000100:00100000:2.0:1788873850.161823:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840167936:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873850.161857:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873850.161897:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9be81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a976a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162019:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162040:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162056:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162069:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162108:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162116:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162244:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162255:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162261:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873850.162331:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788873850.162337:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873850.162363:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162379:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162388:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162395:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162403:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162420:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440031000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873850.162425:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162435:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162451:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873850.162455:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873850.162461:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162468:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9be88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162487:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162493:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162500:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162505:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873850.162507:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162513:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162532:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:2.0:1788873850.162535:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873850.162538:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162544:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9be8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162580:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9be81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a976a expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162596:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a976a expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.162604:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873850.162606:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873850.162609:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873850.162701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11394:x1875769840167936:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 883us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873850.162709:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 120 00000100:00100000:3.0:1788873850.166589:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873850.166652:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.167247:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840168320 00000100:00100000:0.0:1788873850.167262:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840168320 00000100:00100000:0.0:1788873850.167367:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:0.0:1788873850.167380:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+62:2399:x1875769840168320:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873850.167404:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873850.167440:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9be96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a976a expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.167465:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.167472:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873850.167542:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+61:2399:x1875769840168320:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 165us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.167550:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:0.0:1788873850.167583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840168192 00000100:00100000:0.0:1788873850.167587:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840168192 00000100:00100000:0.0:1788873850.167614:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 121 00000100:00100000:0.0:1788873850.167620:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840168192:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873850.167641:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873850.167663:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9771 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.169393:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.169449:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.169461:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.169515:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.169536:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 62 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873850.169557:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f41b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859118976:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873850.169756:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788873850.173311:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f41b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859118976:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873850.173355:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873850.173582:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873850.174062:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840168448 00000100:00100000:2.0:1788873850.174073:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840168448 00010000:00010000:2.0:1788873850.174127:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 63 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873850.174245:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 72 00000100:00100000:2.0:1788873850.174259:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+63:2400:x1875769840168448:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873850.174319:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873850.174330:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 63 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.174348:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 63 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.174384:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9be6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a975c expref: 63 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.174406:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873850.174412:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.174425:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.174436:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873850.174473:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873850.174554:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+62:2400:x1875769840168448:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 296us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873850.174562:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 72 00010000:00010000:0.0:1788873850.175058:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.175078:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873850.175103:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788873850.175342:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9be9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.175371:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.175378:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.175380:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788873850.175383:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93a00, rc 0) 00000100:00100000:0.0:1788873850.175423:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11394:x1875769840168192:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 7802us (8849us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788873850.175431:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 121 00000100:00100000:3.0:1788873850.178672:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.178763:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840168704 00000100:00100000:0.0:1788873850.178777:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840168704 00000100:00100000:0.0:1788873850.178868:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:0.0:1788873850.178881:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11394:x1875769840168704:12345-192.168.202.20@tcp:103:lfs.0 00010000:00010000:0.0:1788873850.178901:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873850.178935:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9bdf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9740 expref: 62 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.179050:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.179056:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873850.179164:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840168704:12345-192.168.202.20@tcp:103:lfs.0 Request processed in 286us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.179173:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788873850.181992:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.182284:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840168832 00000100:00100000:0.0:1788873850.182307:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840168832 00000100:00100000:0.0:1788873850.182394:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:0.0:1788873850.182487:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840168832:12345-192.168.202.20@tcp:58:lfs.0 00010000:00010000:0.0:1788873850.182655:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.182676:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.182688:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873850.182831:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788873850.182940:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840168832:12345-192.168.202.20@tcp:58:lfs.0 Request processed in 458us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.182949:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:3.0:1788873850.185239:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.185629:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840168960 00000100:00100000:0.0:1788873850.185644:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840168960 00000100:00100000:0.0:1788873850.185721:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 123 00000100:00100000:0.0:1788873850.185735:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+61:11394:x1875769840168960:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873850.185764:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873850.185792:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9778 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.185873:0:8993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.185886:0:8993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 62 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.185910:0:8993:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.185946:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 62 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.186157:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.186161:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873850.186166:0:8993:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 62 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.186177:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd92800, rc 0) 00000100:00100000:0.0:1788873850.186271:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11394:x1875769840168960:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 539us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.186279:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 123 00000040:00080000:2.0:1788873850.927722:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788873850.927738:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788873850.927789:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788873850.927805:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788873850.928021:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859119104:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788873850.928252:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873850.933498:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859119104:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788873850.939341:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.939513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840169088 00000100:00100000:0.0:1788873850.939526:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840169088 00000100:00100000:0.0:1788873850.939600:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 124 00000100:00100000:0.0:1788873850.939612:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11395:x1875769840169088:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788873850.939649:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788873850.940276:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11395:x1875769840169088:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 664us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.940296:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 124 00000100:00100000:1.0:1788873850.948059:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.948429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840169216 00000100:00100000:0.0:1788873850.948444:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840169216 00000100:00100000:0.0:1788873850.948584:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 125 00000100:00100000:0.0:1788873850.948599:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11395:x1875769840169216:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788873850.948708:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948752:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948768:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948806:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948815:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948823:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948854:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948865:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948873:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873850.948947:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788873850.948953:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873850.948969:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.948983:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949001:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949009:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949017:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873850.949023:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949033:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949049:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:0.0:1788873850.949052:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873850.949058:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949065:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93400/0x25c660afb0a9bec0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949081:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949087:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949092:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949098:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873850.949107:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949114:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949122:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9d33410dc800) 00010000:00010000:0.0:1788873850.949125:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873850.949127:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949132:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bec7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949148:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949153:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949159:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949164:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873850.949167:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949173:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949180:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.949182:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873850.949192:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.949570:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9bece lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873850.949690:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11395:x1875769840169216:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 Request processed in 1091us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.949700:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 125 00000100:00100000:3.0:1788873850.952717:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.952826:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840169472 00000100:00100000:0.0:1788873850.952839:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840169472 00000100:00100000:0.0:1788873850.952919:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 126 00000100:00100000:0.0:1788873850.952931:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+62:11395:x1875769840169472:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873850.952971:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873850.953000:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9bed5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a977f expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953154:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953173:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953716:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873850.953736:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788873850.953849:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953857:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953882:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953888:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873850.953893:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953901:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953916:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873850.953920:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788873850.953926:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953933:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bedc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.953997:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9bed5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a977f expref: 64 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.954009:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:0.0:1788873850.954011:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788873850.954015:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9bed5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a977f expref: 64 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.954025:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8400, rc 0) 00000100:00100000:0.0:1788873850.954099:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11395:x1875769840169472:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 1169us (1398us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788873850.954117:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 126 00000100:00100000:3.0:1788873850.966841:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.966984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840169600 00000100:00100000:0.0:1788873850.966999:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840169600 00000100:00100000:0.0:1788873850.967079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 127 00000100:00100000:0.0:1788873850.967092:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11395:x1875769840169600:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788873850.967147:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788873850.967642:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11395:x1875769840169600:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 549us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873850.967651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 127 00000100:00100000:1.0:1788873850.972386:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873850.972624:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840169856 00000100:00100000:0.0:1788873850.972638:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840169856 00000100:00100000:0.0:1788873850.972718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 128 00000100:00100000:0.0:1788873850.972732:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11395:x1875769840169856:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873850.972763:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873850.972767:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788873850.972804:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92a00/0x25c660afb0a9be7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9763 expref: 63 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.972829:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873850.972836:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873850.972854:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9beea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9786 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788873850.973734:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788873850.975611:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.975655:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.975670:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.975758:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9beea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9786 expref: 65 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.975783:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9786 expref: 64 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873850.975795:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d33410dc800) 00010000:00010000:0.0:1788873850.975798:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873850.975803:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9000, rc 0) 00000100:00100000:0.0:1788873850.975904:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+64:11395:x1875769840169856:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 3173us (3533us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788873850.975915:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 128 00010000:00010000:0.0:1788873850.991161:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873850.999618:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873850.999834:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840170112 00000100:00100000:2.0:1788873850.999848:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840170112 00000100:00100000:2.0:1788873850.999945:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 129 00000100:00100000:2.0:1788873850.999958:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+64:11395:x1875769840170112:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788873851.000041:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873851.000087:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9bef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9786 expref: 64 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000117:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d33410dc800) 00010000:00010000:2.0:1788873851.000131:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873851.000162:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000191:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000264:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000296:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000305:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000313:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000387:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000672:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000679:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000686:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873851.000691:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000700:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000710:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:2.0:1788873851.000714:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873851.000718:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000725:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9beff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000737:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000743:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000749:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000764:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873851.000768:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000774:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000782:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe3d53e28 (ffff9d3446399d00) 00010000:00010000:2.0:1788873851.000785:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873851.000787:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.000793:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9bf06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe3d53e28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.000907:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11395:x1875769840170112:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 948us (1300us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873851.000918:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 129 00000100:00100000:1.0:1788873851.003875:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.003962:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840170240 00000100:00100000:2.0:1788873851.003976:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840170240 00000100:00100000:2.0:1788873851.004080:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 130 00000100:00100000:2.0:1788873851.004092:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+63:11395:x1875769840170240:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873851.004120:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873851.004155:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bf0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a978d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.004673:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.004714:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.004729:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.004879:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9bf0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.004901:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.004912:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:2.0:1788873851.004915:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788873851.004920:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030c00, rc 0) 00000100:00100000:2.0:1788873851.005029:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+64:11395:x1875769840170240:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 939us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.005039:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 130 00000100:00080000:3.0:1788873851.006070:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873851.008999:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.009110:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840170496 00000100:00100000:0.0:1788873851.009123:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840170496 00000100:00100000:2.0:1788873851.009514:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 131 00000100:00100000:2.0:1788873851.009540:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+64:11395:x1875769840170496:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788873851.009663:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.009686:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.009701:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873851.009946:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788873851.009959:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387955753628ns, next at 388955750631ns, rc = 0 00000004:00010000:2.0:1788873851.010036:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006cb3733 reply state 00000000d9326b1d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.010052:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.010062:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:2.0:1788873851.010066:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788873851.010072:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788873851.010260:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+66:11395:x1875769840170496:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 722us (1276us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788873851.010269:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 131 00000100:00100000:0.0:1788873851.013158:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873851.013555:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840170624 00000100:00100000:3.0:1788873851.013571:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840170624 00000100:00100000:3.0:1788873851.013649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 132 00000100:00100000:3.0:1788873851.013661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+66:11395:x1875769840170624:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873851.013693:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873851.013722:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9794 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.013800:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.013819:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.013845:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:3.0:1788873851.013849:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873851.013855:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443200, rc 0) 00000100:00100000:3.0:1788873851.013936:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+67:11395:x1875769840170624:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 277us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873851.013944:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 132 00000100:00100000:1.0:1788873851.022044:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.022267:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840170752 00000100:00100000:2.0:1788873851.022282:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840170752 00000100:00100000:2.0:1788873851.022385:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:2.0:1788873851.022408:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840170752:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788873851.022872:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840170752:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 475us (842us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788873851.022882:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00080000:3.0:1788873851.024856:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873851.027268:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873851.031930:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840171008 00000100:00100000:1.0:1788873851.032336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840171008 00000100:00100000:3.0:1788873851.032813:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:3.0:1788873851.032833:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+67:11395:x1875769840171008:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788873851.033187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+68:11395:x1875769840171008:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 360us (6027us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788873851.033254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:0.0:1788873851.039122:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.039357:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840171264 00000100:00100000:2.0:1788873851.039372:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840171264 00000100:00100000:2.0:1788873851.039612:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 133 00000100:00100000:2.0:1788873851.039624:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+68:11395:x1875769840171264:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788873851.039883:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+68:11395:x1875769840171264:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 261us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.039892:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 133 00000100:00100000:0.0:1788873851.044766:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873851.044947:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840171392 00000100:00100000:1.0:1788873851.044961:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840171392 00000100:00100000:0.0:1788873851.045697:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 134 00000100:00100000:0.0:1788873851.045712:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+68:11395:x1875769840171392:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873851.045741:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873851.045894:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bf29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a979b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.046774:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9bf30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.046866:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9bf30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.046884:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9bf30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873851.046949:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873851.047036:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9bf30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.047138:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9bf29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a979b expref: 70 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.047164:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9bf30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a979b expref: 69 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.047345:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:0.0:1788873851.047350:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788873851.047356:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8c00, rc 0) 00000100:00100000:0.0:1788873851.047524:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+69:11395:x1875769840171392:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 1815us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.047534:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 134 00000100:00100000:3.0:1788873851.051972:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.052105:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840171520 00000100:00100000:2.0:1788873851.052121:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840171520 00000100:00100000:2.0:1788873851.052237:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:2.0:1788873851.052251:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840171520:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873851.052277:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873851.052320:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97a2 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873851.052358:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa00c7b, blocks: 0x0 00010000:00010000:2.0:1788873851.052392:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788873851.052411:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873851.052424:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 10 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.052447:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 10 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.052467:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440031000, rc 0) 00000100:00100000:2.0:1788873851.052555:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2401:x1875769840171520:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 308us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.052563:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:3.0:1788873851.057360:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.057682:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840171776 00000100:00100000:0.0:1788873851.057695:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840171776 00000100:00100000:0.0:1788873851.057805:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 135 00000100:00100000:0.0:1788873851.057818:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+69:11395:x1875769840171776:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788873851.057963:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+69:11395:x1875769840171776:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 147us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.057971:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 135 00000100:00100000:0.0:1788873851.063156:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.063939:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840171904 00000100:00100000:2.0:1788873851.063976:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840171904 00000100:00100000:2.0:1788873851.064158:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:2.0:1788873851.064171:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+10:11395:x1875769840171904:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873851.064238:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873851.064265:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.064323:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.064335:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788873851.064339:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873851.064346:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.064406:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.064425:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 11 pid: 8425 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.064443:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875769859119232:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873851.064739:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.069719:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.069789:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875769859119232:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873851.069887:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.069945:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030600, rc 0) 00000100:00100000:0.0:1788873851.070156:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172032 00000100:00100000:0.0:1788873851.070166:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172032 00010000:00010000:0.0:1788873851.070326:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 12 pid: 8425 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873851.070372:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 73 00000100:00100000:0.0:1788873851.070385:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458497450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+12:2400:x1875769840172032:12345-192.168.202.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788873851.070924:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+12:11395:x1875769840171904:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 6752us (7780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.070933:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 47 00010000:00010000:0.0:1788873851.071047:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873851.071391:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 11 pid: 8425 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.071616:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 11 pid: 8425 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.071651:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bf37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a2 expref: 11 pid: 8425 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.071672:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873851.071677:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873851.071688:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.071717:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.071769:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873851.072725:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f418000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1875769859119360:192.168.202.20@tcp:105: 00000100:00100000:0.0:1788873851.073505:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73780 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.080262:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873851.083070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172160 00000100:00100000:1.0:1788873851.083096:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172160 00002000:00100000:1.0:1788873851.083191:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d3344133b80 x1875769840172160/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:267/0 lens 504/0 e 0 to 0 dl 1788873862 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873851.083256:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3344133b80 with x1875769840172160 ext(0->12) 00002000:00010000:1.0:1788873851.083264:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3344133b80 00000100:00100000:1.0:1788873851.083317:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:1.0:1788873851.083328:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2399:x1875769840172160:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788873851.084734:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f418000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1875769859119360:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788873851.084913:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873851.085125:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2399:x1875769840172160:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 Request processed in 1796us (4923us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788873851.085139:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 2 00002000:00100000:1.0:1788873851.085153:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d3344133b80 x1875769840172160/t4294967309(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:267/0 lens 504/448 e 0 to 0 dl 1788873862 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873851.085166:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3344133b80 with x1875769840172160 ext(0->12) 00002000:00010000:1.0:1788873851.085180:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3344133b80 00000100:00100000:0.0:1788873851.087347:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458497450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+12:2400:x1875769840172032:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 16943us (17616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.087367:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 73 00000100:00100000:2.0:1788873851.087587:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873851.088003:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172288 00000100:00100000:3.0:1788873851.088014:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172288 00000100:00100000:3.0:1788873851.088086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 136 00000100:00100000:3.0:1788873851.088096:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+69:11395:x1875769840172288:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788873851.089955:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788873851.089974:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:1.0:1788873851.090048:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090071:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090081:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090088:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873851.090093:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090102:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090126:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d3476dc2600) 00010000:00010000:1.0:1788873851.090129:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873851.090135:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090141:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9bc43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090197:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090233:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090240:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090246:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873851.090248:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090254:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090262:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d3446399b00) 00010000:00010000:1.0:1788873851.090264:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873851.090267:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090273:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bceb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090300:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090308:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090314:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090324:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873851.090328:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090334:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090341:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:1.0:1788873851.090343:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873851.090346:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090353:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92000/0x25c660afb0a9bd69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090364:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090370:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090375:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090381:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873851.090384:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090389:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090405:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d33410dc200) 00010000:00010000:1.0:1788873851.090407:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873851.090410:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090415:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9bd8c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090429:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090435:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090442:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090446:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873851.090449:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090453:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090460:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:1.0:1788873851.090462:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873851.090464:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090469:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9be5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090487:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090493:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090499:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090503:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440031600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873851.090506:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090511:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090518:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:1.0:1788873851.090520:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788873851.090523:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.090528:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873851.090626:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788873851.090648:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d33427530c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788873851.090652:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a77a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3342753e40 00000020:00080000:2.0:1788873851.090655:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a77a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3342539000 00000004:00080000:2.0:1788873851.090685:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788873851.091001:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788873851.091488:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859119488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788873851.091590:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873851.091724:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859119488 00000100:00100000:3.0:1788873851.091733:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859119488 00000100:00100000:3.0:1788873851.091826:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788873851.091837:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1875769859119488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788873851.091873:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1788873851.091918:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa00c7a, atime: 0x6aa00c7a, ctime: 0x6aa00c7a, blocks: 0x8 00010000:00010000:3.0:1788873851.091927:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.091949:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1788873851.091954:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873851.091962:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.091982:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.092013:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.092020:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.092039:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788873851.093219:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3633:x1875769859119488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1356us (1601us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788873851.093234:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788873851.093280:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873851.093302:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.093315:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873851.093321:0:10332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.093332:0:10332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.093357:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.093366:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020e6e2f9/0x25c660afb0a9bf45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.093408:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873851.093411:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873851.093413:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788873851.093471:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3344195180/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788873851.093479:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859119488:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788873851.093736:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873851.093999:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f41b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859119744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788873851.094063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873851.094132:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873851.094143:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859119616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788873851.094170:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788873851.094538:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3459fa50c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788873851.094544:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a562100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3459fa53c0 00000020:00080000:2.0:1788873851.094547:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a562d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d344fce0c00 00000020:00080000:2.0:1788873851.094568:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1788873851.094597:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859119744 00000100:00100000:2.0:1788873851.094607:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859119744 00000100:00100000:2.0:1788873851.094667:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859119616 00000100:00100000:2.0:1788873851.094670:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859119616 00000100:00100000:2.0:1788873851.094694:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873851.094704:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875769859119744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788873851.094872:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788873851.094876:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788873851 00002000:00010000:2.0:1788873851.094888:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788873851.094890:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788873851 -> 1788873851 00002000:00010000:2.0:1788873851.094893:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:3.0:1788873851.094969:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788873851.095027:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788873851.095042:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788873851.095050:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3633:x1875769859119616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788873851.097827:0:8789:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1788873851.097873:0:8789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.097902:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.097912:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788873851.097917:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873851.097922:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.097971:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.098008:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 11 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873851.098026:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344132300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859119872:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873851.098381:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.098521:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11395:x1875769840172288:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 Request processed in 10424us (10934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873851.098532:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 136 00000100:00080000:0.0:1788873851.101169:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873851.101276:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3635:x1875769859119744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6564us (7213us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788873851.101305:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873851.101723:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.101812:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873851.101917:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344132300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859119872:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873851.101952:0:8789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788873851.102047:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d347f41b800/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788873851.102126:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f41b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859119744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788873851.102160:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172544 00000100:00100000:1.0:1788873851.102168:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172544 00010000:00010000:1.0:1788873851.102347:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 12 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873851.102424:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 74 00000100:00100000:1.0:1788873851.102435:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+12:2400:x1875769840172544:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873851.102453:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873851.102460:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 12 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.102474:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 12 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.102505:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90b3be1/0x25c660afb0a9bcf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9701 expref: 12 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.102525:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788873851.102530:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788873851.102538:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.102550:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.102610:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873851.102674:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2400:x1875769840172544:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 241us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873851.102683:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 74 00010000:00010000:3.0:1788873851.102731:0:8789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.102741:0:8789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.102754:0:8789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.102764:0:8789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.102802:0:8789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788873851.103019:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3633:x1875769859119616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7969us (8848us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788873851.103028:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788873851.103053:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172416 00000100:00100000:3.0:1788873851.103069:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172416 00000100:00100000:0.0:1788873851.103155:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:0.0:1788873851.103166:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d344ff49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2401:x1875769840172416:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788873851.103743:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873851.103752:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.103762:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873851.103767:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.103777:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.103796:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.103804:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.103833:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873851.103836:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873851.103837:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788873851.103882:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d347f418000/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788873851.103889:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859119616:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788873851.106648:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788873851.106673:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788873851.106890:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d344ff49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840172416:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 Request processed in 3719us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873851.106903:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:3.0:1788873851.119018:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859120000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873851.119112:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873851.119237:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859120000 00000100:00100000:3.0:1788873851.119247:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859120000 00000100:00100000:3.0:1788873851.119331:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788873851.119349:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3636:x1875769859120000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873851.119393:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788873851.119450:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3636:x1875769859120000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873851.119457:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788873851.119519:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859120000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873851.119761:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873851.119772:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859120128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873851.119806:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.119990:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859120128 00000100:00100000:0.0:1788873851.119996:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859120128 00000100:00100000:0.0:1788873851.120042:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788873851.120049:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859120128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788873851.120062:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788873851.120095:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859120128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.120121:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788873851.120452:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873851.120484:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859120128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873851.120897:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.123399:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172800 00000100:00100000:0.0:1788873851.123423:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172800 00000100:00100000:0.0:1788873851.123528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 137 00000100:00100000:0.0:1788873851.123541:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11395:x1875769840172800:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788873851.123629:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873851.123669:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9bf30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a979b expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.123698:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:0.0:1788873851.123706:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873851.123756:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.123772:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.123784:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873851.123940:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab506a8e reply state 0000000059ee33c7 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.123953:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.124345:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:0.0:1788873851.124350:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873851.124355:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873851.125516:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+17:11395:x1875769840172800:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 1965us (4610us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1788873851.125529:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 137 00000100:00100000:0.0:1788873851.132619:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.132962:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840172928 00000100:00100000:2.0:1788873851.132977:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840172928 00000100:00100000:2.0:1788873851.133056:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:2.0:1788873851.133070:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840172928:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788873851.133336:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788873851.133340:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788873851 -> 1788873850 00002000:00010000:2.0:1788873851.133343:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788873850 00002000:00010000:2.0:1788873851.133345:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788873851 -> 1788873850 00002000:00010000:2.0:1788873851.133348:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788873851.133429:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840172928:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 362us (827us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788873851.133437:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:1.0:1788873851.138737:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.138924:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840173184 00000100:00100000:2.0:1788873851.138938:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840173184 00000100:00100000:2.0:1788873851.139034:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:2.0:1788873851.139047:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+17:11395:x1875769840173184:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788873851.139167:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.139264:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.139279:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.139340:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.139358:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 17 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.139378:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859120256:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873851.139489:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.144877:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.145006:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840173312 00000100:00100000:0.0:1788873851.145023:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840173312 00010000:00010000:0.0:1788873851.145077:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 18 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873851.145126:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 75 00000100:00100000:0.0:1788873851.145136:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2401:x1875769840173312:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873851.145153:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873851.145162:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 18 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.145179:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 18 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.145280:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859120256:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873851.146118:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9bf14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a978d expref: 18 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.148764:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:2.0:1788873851.148769:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.148780:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.148869:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.148878:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.148927:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873851.150411:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150418:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150477:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150486:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150517:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150524:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873851.150529:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150539:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150562:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:2.0:1788873851.150566:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788873851.150571:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.150578:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9bf5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873851.152500:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+17:2401:x1875769840173312:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 7350us (7624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.152516:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 75 00000100:00100000:2.0:1788873851.161012:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11395:x1875769840173184:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 Request processed in 21949us (22272us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788873851.161029:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:0.0:1788873851.169332:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873851.169424:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840173440 00000100:00100000:3.0:1788873851.169435:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840173440 00000100:00100000:3.0:1788873851.169542:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:3.0:1788873851.169553:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840173440:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788873851.169600:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.169639:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.169649:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873851.169654:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873851.169660:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.169713:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.169728:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 7 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873851.169745:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875769859120384:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873851.169845:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788873851.172619:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873851.172971:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875769859120384:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873851.173001:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.175116:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840173568 00000100:00100000:2.0:1788873851.175133:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840173568 00010000:00010000:2.0:1788873851.175190:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 8 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.175294:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 76 00000100:00100000:2.0:1788873851.175306:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840173568:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873851.175340:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873851.175404:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 8 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.175418:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 8 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.175444:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb004edb/0x25c660afb0a9bf3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97a9 expref: 8 pid: 8427 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.175463:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873851.175468:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873851.175474:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.175485:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.175522:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873851.175560:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175584:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.175598:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840173568:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 293us (2986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.175609:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 76 00010000:00010000:3.0:1788873851.175620:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175641:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175649:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175656:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873851.175661:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175671:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175684:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.175693:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9bf61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873851.175744:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840173440:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 Request processed in 6193us (6424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873851.175751:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:2.0:1788873851.180582:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873851.180733:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840173824 00000100:00100000:3.0:1788873851.180745:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840173824 00000100:00100000:3.0:1788873851.180799:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 139 00000100:00100000:3.0:1788873851.180809:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+16:11395:x1875769840173824:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788873851.180893:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.180910:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.180921:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.180959:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.180986:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 16 pid: 8450 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873851.181000:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344131500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859120512:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873851.181086:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34436c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873851.187964:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.188053:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840173952 00000100:00100000:2.0:1788873851.188073:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840173952 00010000:00010000:2.0:1788873851.188115:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 17 pid: 8450 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.188179:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 77 00000100:00100000:2.0:1788873851.188189:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+17:2401:x1875769840173952:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873851.188241:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873851.188249:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 17 pid: 8450 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.188263:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 17 pid: 8450 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.188294:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873851.188301:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 17 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.188313:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.188322:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.188330:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.188353:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873851.188413:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+17:2401:x1875769840173952:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 225us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.188421:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 77 00010000:00010000:1.0:1788873851.189947:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9be57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9755 expref: 16 pid: 8450 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873851.189970:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344131500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859120512:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873851.189992:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190003:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190009:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190459:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190474:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190503:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190540:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.190552:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 16 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873851.190567:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344195c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859120640:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873851.190851:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.203726:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344195c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859120640:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873851.203754:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873851.204486:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873851.204573:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840174080 00000100:00100000:1.0:1788873851.204581:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840174080 00010000:00010000:1.0:1788873851.204622:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873851.204721:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 78 00000100:00100000:1.0:1788873851.204733:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+17:2401:x1875769840174080:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873851.204749:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873851.204757:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.204770:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.204792:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9bf22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9794 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.204831:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:1.0:1788873851.204836:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.204846:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.204855:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.204886:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873851.204948:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+16:2401:x1875769840174080:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 217us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873851.204956:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 78 00010000:00010000:3.0:1788873851.205007:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.205025:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788873851.205155:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788873851.205346:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788873851.205383:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788873851.205461:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859120768:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788873851.205505:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873851.205543:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450502840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873851.206637:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859120768 00000100:00100000:2.0:1788873851.206661:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859120768 00000100:00100000:2.0:1788873851.209371:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788873851.209397:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875769859120768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788873851.209590:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875769859120768:12345-0@lo:1000:mdt00_001.0 Request processed in 205us (4083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.209598:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788873851.209802:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788873851.209809:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1788873851.209833:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d347f41b800, transno 4294967310 00000004:00080000:0.0:1788873851.209846:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d347f418000, transno 4294967311 00000100:00100000:0.0:1788873851.209853:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859120768:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788873851.210119:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788873851.210181:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f41b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859120896:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788873851.210245:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.221414:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73540 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.222491:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859120896 00000100:00100000:3.0:1788873851.222505:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859120896 00000100:00100000:2.0:1788873851.222638:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788873851.222650:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875769859120896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788873851.222895:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1875769859120896:12345-0@lo:1000:mdt00_001.0 Request processed in 248us (12649us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788873851.222904:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788873851.222990:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f41b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875769859120896:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788873851.223038:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223049:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223056:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223075:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecae00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873851.223096:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223105:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223123:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:0.0:1788873851.223126:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873851.223130:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223136:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bf6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223162:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223169:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223174:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223180:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873851.223183:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223188:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223195:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873851.223197:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873851.223240:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223252:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223261:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.223309:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873851.223323:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f41a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859121024:192.168.202.20@tcp:105: 00000100:00100000:0.0:1788873851.223405:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73540 going to sleep for 11 seconds 00000100:00100000:3.0:1788873851.233783:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.234616:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f41a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859121024:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788873851.234648:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234659:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92400/0x25c660afb0a9beb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234699:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234714:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234726:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234761:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234767:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234774:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234779:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873851.234783:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234791:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234802:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873851.234805:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873851.234808:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234814:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9bf76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234823:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234828:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234833:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234844:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873851.234847:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234853:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234860:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873851.234862:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788873851.234865:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873851.234870:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9bf68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873851.235040:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11395:x1875769840173824:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 54231us (54467us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788873851.235050:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 139 00000020:00080000:0.0:1788873851.235057:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788873851.236884:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873851.236895:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788873851.237422:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788873851.237431:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788873851.238442:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840174208 00000100:00100000:2.0:1788873851.238456:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840174208 00000100:00100000:2.0:1788873851.238532:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:2.0:1788873851.238544:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11394:x1875769840174208:12345-192.168.202.20@tcp:49:lfs.0 00000100:00100000:2.0:1788873851.238683:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11394:x1875769840174208:12345-192.168.202.20@tcp:49:lfs.0 Request processed in 141us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.238691:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:3.0:1788873851.241668:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.242467:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840174464 00000100:00100000:2.0:1788873851.242479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840174464 00000100:00100000:2.0:1788873851.242589:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 32 00000100:00100000:2.0:1788873851.242601:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:11395:x1875769840174464:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788873851.242870:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788873851.242905:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788873851.242939:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.242975:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.242987:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.242996:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.243002:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.243008:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.243037:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788873851.244168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11395:x1875769840174464:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 1559us (2499us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788873851.244181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 32 00000020:00080000:2.0:1788873851.244187:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788873851.244399:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873851.244409:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.244419:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788873851.244423:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.244433:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.244449:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:1.0:1788873851.244452:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788873851.244457:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.244482:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873851.244512:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873851.244514:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873851.244516:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873851.245788:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.245861:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840174720 00000100:00100000:0.0:1788873851.245870:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840174720 00000100:00100000:0.0:1788873851.245954:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 140 00000100:00100000:0.0:1788873851.245965:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11394:x1875769840174720:12345-192.168.202.20@tcp:58:lfs.0 00000040:00080000:0.0:1788873851.246191:0:8993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788873851.246327:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11394:x1875769840174720:12345-192.168.202.20@tcp:58:lfs.0 Request processed in 363us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.246335:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 140 00000100:00100000:3.0:1788873851.299772:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.300082:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840174848 00000100:00100000:2.0:1788873851.300093:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840174848 00000100:00100000:2.0:1788873851.300254:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 141 00000100:00100000:2.0:1788873851.300266:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+21:11397:x1875769840174848:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873851.300300:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873851.300327:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97b0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300424:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300445:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300458:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300475:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300484:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300491:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300574:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300586:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300727:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300766:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.300781:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 22 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.300810:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859121152:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873851.300914:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753480 going to sleep for 11 seconds 00000100:00100000:2.0:1788873851.306105:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859121152:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873851.306135:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873851.307854:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873851.308647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840175104 00000100:00100000:0.0:1788873851.308671:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840175104 00000100:00100000:0.0:1788873851.308731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:0.0:1788873851.308742:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+23:6172:x1875769840175104:12345-192.168.202.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788873851.308968:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+24:6172:x1875769840175104:12345-192.168.202.20@tcp:35:ldlm_bl.0 Request processed in 227us (1122us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788873851.308977:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:1.0:1788873851.314350:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873851.318707:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840175232 00000100:00100000:2.0:1788873851.318726:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840175232 00010000:00010000:2.0:1788873851.318783:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 24 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873851.318830:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 79 00000100:00100000:2.0:1788873851.318843:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+24:2400:x1875769840175232:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873851.318859:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873851.318865:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 24 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.318878:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 24 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.318900:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93a00/0x25c660afb0a9bea4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9771 expref: 24 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.318919:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873851.318925:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.318950:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.318959:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873851.319125:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873851.319194:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+23:2400:x1875769840175232:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 353us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873851.319202:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 79 00010000:00010000:3.0:1788873851.319581:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319590:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873851.319641:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788873851.319646:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873851.319667:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319690:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319701:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319708:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319714:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319720:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873851.319725:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319733:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319744:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:3.0:1788873851.319747:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873851.319751:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319756:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9bf8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319768:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319775:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319787:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319792:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440031000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873851.319795:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319801:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319809:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d3476dc6600) 00010000:00010000:3.0:1788873851.319812:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873851.319815:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319821:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bf92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319861:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bf84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97b0 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319876:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97b0 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873851.319883:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:3.0:1788873851.319885:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873851.319887:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030600, rc 0) 00000100:00100000:3.0:1788873851.320467:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+22:11397:x1875769840174848:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 20200us (20727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873851.320487:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 141 00000100:00100000:0.0:1788873851.632575:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859121664:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.632647:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.632694:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859122176:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.632712:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.632734:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788873851.632739:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859121280:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.632763:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.632802:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859121792:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.632825:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.632840:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859122304:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.632855:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.632880:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859121664 00000100:00100000:0.0:1788873851.632886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859121664 00000100:00100000:0.0:1788873851.632924:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122176 00000100:00100000:0.0:1788873851.632926:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122176 00000100:00100000:0.0:1788873851.632966:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122304 00000100:00100000:0.0:1788873851.632968:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122304 00000100:00100000:0.0:1788873851.632983:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788873851.632990:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859121664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633034:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859121664:12345-0@lo:400:kworker.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633047:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788873851.633064:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788873851.633069:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859122176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859122176:12345-0@lo:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633097:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788873851.633106:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788873851.633111:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859122304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633130:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859122304:12345-0@lo:400:kworker.0 Request processed in 19us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633135:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788873851.633153:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859121280 00000100:00100000:0.0:1788873851.633156:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859121280 00000100:00100000:0.0:1788873851.633177:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788873851.633182:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859121280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633229:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859121280:12345-0@lo:400:kworker.0 Request processed in 47us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633234:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788873851.633258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859121792 00000100:00100000:0.0:1788873851.633261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859121792 00000100:00100000:0.0:1788873851.633293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788873851.633300:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859121792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633333:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859121792:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788873851.633389:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859121280:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633403:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859121792:0@lo:400:kworker.0 00010000:00080000:0.0:1788873851.633419:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343806d80 x1875769859122304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873851.633430:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859122304:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633440:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859121664:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633447:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859122176:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633502:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859121408:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633528:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.633546:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859121920:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633565:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.633580:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859122432:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633603:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.633626:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788873851.633632:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859121536:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.633669:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859122048:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633690:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873851.633712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859121408 00000100:00100000:0.0:1788873851.633716:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859121408 00000100:00100000:0.0:1788873851.633737:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859121920 00000100:00100000:0.0:1788873851.633740:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859121920 00000100:00100000:0.0:1788873851.633759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122048 00000100:00100000:0.0:1788873851.633762:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122048 00000100:00100000:0.0:1788873851.633786:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788873851.633791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859121408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859121408:12345-0@lo:400:kworker.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633833:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788873851.633844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788873851.633850:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859121920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633875:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859121920:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788873851.633889:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788873851.633895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859122048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.633918:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859122048:12345-0@lo:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.633923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788873851.633941:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122432 00000100:00100000:0.0:1788873851.633944:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122432 00000100:00100000:0.0:1788873851.633970:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788873851.633976:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859122432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.634004:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859122432:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.634010:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788873851.634027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859121536 00000100:00100000:0.0:1788873851.634030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859121536 00000100:00100000:0.0:1788873851.634049:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788873851.634054:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859121536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.634092:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859121536:12345-0@lo:400:kworker.0 Request processed in 38us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873851.634098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788873851.634135:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859121536:0@lo:400:kworker.0 00010000:00080000:0.0:1788873851.634145:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334401a680 x1875769859122048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873851.634155:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859122048:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.634164:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859121408:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.634173:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859121920:0@lo:400:kworker.0 00000100:00100000:0.0:1788873851.634181:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859122432:0@lo:400:kworker.0 00000100:00080000:3.0:1788873851.634346:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873851.634351:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873851.634353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788873851.971583:0:14257:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873851.971595:0:14257:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873851.971641:0:14257:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788873851.971647:0:14257:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788873852.015604:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873852.142840:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859122560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873852.142910:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873852.143147:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122560 00000100:00100000:2.0:1788873852.143156:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122560 00000100:00100000:3.0:1788873852.143315:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859122688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873852.143348:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873852.143395:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122688 00000100:00100000:3.0:1788873852.143399:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122688 00000100:00100000:3.0:1788873852.143428:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788873852.143436:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859122688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873852.143458:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788873852.143504:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859122688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873852.143511:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788873852.143555:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859122688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873852.143772:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788873852.143781:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859122560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873852.143807:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873852.143969:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873852.143979:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859122816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873852.144006:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873852.144446:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859122816 00000100:00100000:3.0:1788873852.144451:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859122816 00000100:00100000:3.0:1788873852.144481:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788873852.144488:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859122816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873852.144501:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788873852.144541:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859122816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873852.144547:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788873852.144579:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859122816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873852.144940:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859122560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1160us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.144949:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788873852.145031:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859122560:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788873852.145737:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788873852.145749:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:2.0:1788873852.271492:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788873852.271503:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788873852.271529:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788873852.271537:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788873852.271674:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343807480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859122944:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788873852.272085:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873852.278650:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343807480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859122944:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788873852.280463:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873852.280602:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840175360 00000100:00100000:0.0:1788873852.280612:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840175360 00000100:00100000:0.0:1788873852.280677:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 142 00000100:00100000:0.0:1788873852.280688:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+22:11409:x1875769840175360:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788873852.280724:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788873852.281086:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+22:11409:x1875769840175360:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 399us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873852.281093:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 142 00000100:00100000:0.0:1788873852.289949:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873852.290027:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840175616 00000100:00100000:2.0:1788873852.290037:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840175616 00000100:00100000:2.0:1788873852.290307:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 143 00000100:00100000:2.0:1788873852.290320:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+22:11409:x1875769840175616:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873852.290342:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873852.290364:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfa0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97b7 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873852.290479:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873852.290495:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873852.290509:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873852.290520:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788873852.290624:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfa0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97b7 expref: 25 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873852.290644:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97b7 expref: 24 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873852.290653:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873852.290656:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873852.290660:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440031000, rc 0) 00000100:00100000:2.0:1788873852.290727:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+24:11409:x1875769840175616:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 409us (784us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788873852.290745:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 143 00000100:00100000:1.0:1788873852.295432:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873852.295525:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840175744 00000100:00100000:2.0:1788873852.295536:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840175744 00000100:00100000:2.0:1788873852.295609:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:2.0:1788873852.295620:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+24:2399:x1875769840175744:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873852.295637:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873852.295664:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97b7 expref: 24 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873852.295685:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873852.295690:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873852.295748:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+23:2399:x1875769840175744:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.295756:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:3.0:1788873852.301756:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873852.302013:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176000 00000100:00100000:0.0:1788873852.302024:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176000 00000100:00100000:0.0:1788873852.302143:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 144 00000100:00100000:0.0:1788873852.302155:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+23:11409:x1875769840176000:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788873852.302303:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302323:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302337:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302504:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302512:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302518:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302524:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873852.302528:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302536:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302548:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873852.302551:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788873852.302568:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873852.302575:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9bfb5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873852.302711:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+24:11409:x1875769840176000:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 556us (960us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788873852.302720:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 144 00000040:00080000:3.0:1788873852.302889:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873852.302894:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788873852.303410:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788873852.303417:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788873852.305998:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873852.306074:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176256 00000100:00100000:2.0:1788873852.306083:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176256 00000100:00100000:2.0:1788873852.306317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:2.0:1788873852.306331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+24:11409:x1875769840176256:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788873852.306581:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+25:11409:x1875769840176256:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 254us (592us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788873852.306586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:1.0:1788873852.560888:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873852.560927:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873852.560975:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873852.561004:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873852.561029:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873852.561070:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873852.561106:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176384 00000100:00100000:1.0:1788873852.561115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176384 00000100:00100000:1.0:1788873852.561161:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 381 00000100:00100000:1.0:1788873852.561170:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840176384:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873852.561285:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840176384:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 115us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873852.561293:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 381 00000100:00100000:2.0:1788873852.561389:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176640 00000100:00100000:2.0:1788873852.561393:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176640 00000100:00100000:2.0:1788873852.561439:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176768 00000100:00100000:2.0:1788873852.561442:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176768 00000100:00100000:2.0:1788873852.561459:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:2.0:1788873852.561472:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840176640:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873852.561502:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840176640:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 31us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.561508:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:2.0:1788873852.561529:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 115 00000100:00100000:2.0:1788873852.561535:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840176768:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873852.561560:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840176768:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.561566:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 115 00000100:00100000:2.0:1788873852.561599:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176512 00000100:00100000:2.0:1788873852.561603:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176512 00000100:00100000:2.0:1788873852.561626:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177024 00000100:00100000:2.0:1788873852.561629:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177024 00000100:00100000:2.0:1788873852.561643:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840176896 00000100:00100000:2.0:1788873852.561646:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840176896 00000100:00100000:2.0:1788873852.561662:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 302 00000100:00100000:2.0:1788873852.561668:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840176512:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873852.561696:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840176512:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 28us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.561702:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 302 00000100:00100000:2.0:1788873852.561715:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 303 00000100:00100000:2.0:1788873852.561720:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840177024:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873852.561741:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840177024:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 21us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.561747:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 303 00000100:00100000:2.0:1788873852.561766:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 304 00000100:00100000:2.0:1788873852.561772:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840176896:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873852.561796:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840176896:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873852.561802:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 304 00000100:00080000:1.0:1788873852.564549:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873852.564558:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873852.564561:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788873853.039351:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788873853.840991:0:14309:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873853.841002:0:14309:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788873853.841041:0:14309:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788873853.841047:0:14309:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788873854.010630:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873854.010872:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177280 00000100:00100000:2.0:1788873854.010884:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177280 00000100:00100000:2.0:1788873854.010965:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 145 00000100:00100000:2.0:1788873854.010976:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+25:11429:x1875769840177280:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873854.011001:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873854.011022:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97be expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.011138:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.011154:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.011168:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873854.011180:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788873854.011339:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97be expref: 28 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.011357:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97be expref: 27 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.011386:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873854.011389:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788873854.011394:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440031600, rc 0) 00000100:00100000:2.0:1788873854.011455:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+27:11429:x1875769840177280:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 482us (836us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788873854.011475:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 145 00000100:00080000:1.0:1788873854.011605:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788873854.019167:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873854.019325:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177408 00000100:00100000:2.0:1788873854.019335:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177408 00000100:00100000:2.0:1788873854.019393:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 146 00000100:00100000:2.0:1788873854.019404:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+27:11429:x1875769840177408:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:2.0:1788873854.019683:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019704:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019717:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019891:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019899:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019905:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019910:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440031000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873854.019924:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019932:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019944:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:2.0:1788873854.019947:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873854.019951:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.019958:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031000/0x25c660afb0a9bfd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873854.020077:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+27:11429:x1875769840177408:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 674us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873854.020086:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 146 00010000:00010000:3.0:1788873854.066113:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873854.135310:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873854.135404:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177536 00000100:00100000:2.0:1788873854.135414:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177536 00000100:00100000:2.0:1788873854.135503:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:2.0:1788873854.135514:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840177536:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:2.0:1788873854.135543:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873854.135565:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bfd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97c5 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873854.135595:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa00c7a, atime: 0x6aa00c7a, ctime: 0x6aa00c7a, blocks: 0x8 00010000:00010000:2.0:1788873854.135617:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1788873854.135622:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873854.135632:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bfd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97c5 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.135666:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bfd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97c5 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873854.135680:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440031000, rc 0) 00000100:00100000:2.0:1788873854.135740:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2398:x1875769840177536:12345-192.168.202.20@tcp:101:cat.0 Request processed in 228us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873854.135755:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00080000:1.0:1788873854.136644:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873854.139625:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873854.143625:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177664 00000100:00100000:1.0:1788873854.143646:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177664 00002000:00100000:1.0:1788873854.143721:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9d3344131500 x1875769840177664/t0(0) o3->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:270/0 lens 488/0 e 0 to 0 dl 1788873865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873854.143733:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3344131500 with x1875769840177664 ext(0->4095) 00002000:00010000:1.0:1788873854.143740:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3344131500 00000100:00100000:1.0:1788873854.143778:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:1.0:1788873854.143788:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840177664:12345-192.168.202.20@tcp:3:cat.0 00000100:00100000:1.0:1788873854.144000:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840177664:12345-192.168.202.20@tcp:3:cat.0 Request processed in 212us (4385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788873854.144009:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00002000:00100000:1.0:1788873854.144017:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9d3344131500 x1875769840177664/t0(0) o3->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:270/0 lens 488/4536 e 0 to 0 dl 1788873865 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873854.144025:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3344131500 with x1875769840177664 ext(0->4095) 00002000:00010000:1.0:1788873854.144028:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3344131500 00000100:00100000:0.0:1788873854.702554:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873854.702578:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859123072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873854.702651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873854.702701:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123072 00000100:00100000:2.0:1788873854.702709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123072 00000100:00100000:2.0:1788873854.702765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788873854.702774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859123072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873854.702807:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788873854.702933:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859123072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873854.702940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788873854.703506:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859123072:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788873855.086488:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873856.110459:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873856.239151:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873856.239172:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859123200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873856.239294:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873856.239460:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859123328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873856.239503:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873856.239546:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123200 00000100:00100000:1.0:1788873856.239553:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123200 00000100:00100000:1.0:1788873856.239603:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123328 00000100:00100000:1.0:1788873856.239607:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123328 00000100:00100000:1.0:1788873856.239623:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788873856.239631:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859123200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788873856.239660:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873856.239703:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859123200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873856.239711:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788873856.239726:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788873856.239733:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859123328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873856.239742:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873856.239771:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859123328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873856.239776:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788873856.239793:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873856.239820:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788873856.239826:0:3633:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1788873856.239847:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d33427d2d80, transno 4294967302 00000004:00080000:1.0:1788873856.239856:0:3633:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788873856.239866:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3344195180, transno 4294967305 00000100:00100000:1.0:1788873856.239878:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859123328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873856.240336:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859123200:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788873856.244038:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788873856.244178:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3343b73240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788873856.244183:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a562500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3343b73480 00000020:00080000:1.0:1788873856.244186:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a562600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d34462f4200 00000020:00080000:1.0:1788873856.244232:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788873856.244486:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788873856.244551:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788873856.244581:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873856.244592:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873856.244600:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873856.244606:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873856.244611:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873856.244619:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873856.244638:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d3446399700) 00010000:00010000:1.0:1788873856.244641:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873856.244646:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873856.244652:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9bf53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873856.751326:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859123712:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.751531:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859123456:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.751611:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873856.751679:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859123968:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.751850:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873856.751920:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859124480:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.752001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873856.752044:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788873856.752053:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859123840:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.752082:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873856.752105:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859124352:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.752126:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873856.752174:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123456 00000100:00100000:3.0:1788873856.752185:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123456 00000100:00100000:0.0:1788873856.752261:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859123584:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.752322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788873856.752336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873856.752357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859123456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873856.752391:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859124096:0@lo:400:kworker.0 00000100:00100000:0.0:1788873856.752431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873856.752452:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859124608:0@lo:400:kworker.0 00000100:00100000:0.0:1788873856.752475:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873856.752517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124480 00000100:00100000:0.0:1788873856.752523:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124480 00000100:00100000:0.0:1788873856.752570:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123840 00000100:00100000:0.0:1788873856.752573:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123840 00000100:00100000:0.0:1788873856.752583:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124352 00000100:00100000:0.0:1788873856.752586:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124352 00000100:00100000:0.0:1788873856.752596:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123584 00000100:00100000:0.0:1788873856.752608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123584 00000100:00100000:0.0:1788873856.752620:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124096 00000100:00100000:0.0:1788873856.752623:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124096 00000100:00100000:0.0:1788873856.752652:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788873856.752660:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859123456:12345-0@lo:400:kworker.0 Request processed in 303us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873856.752670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859124480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.752679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788873856.752739:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123968 00000100:00100000:0.0:1788873856.752740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859124480:12345-0@lo:400:kworker.0 Request processed in 74us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873856.752747:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123968 00000100:00100000:0.0:1788873856.752754:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788873856.752783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788873856.752795:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788873856.752798:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859123840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.752810:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859123968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873856.752847:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859123840:12345-0@lo:400:kworker.0 Request processed in 54us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873856.752859:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788873856.752874:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859123968:12345-0@lo:400:kworker.0 Request processed in 67us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873856.752885:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788873856.753029:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788873856.753044:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859124352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873856.753088:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859124352:12345-0@lo:400:kworker.0 Request processed in 49us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873856.753254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873856.753280:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859124224:0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873856.753315:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859124736:0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788873856.753382:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873856.753386:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788873856.753397:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859123712 00000100:00100000:1.0:1788873856.753402:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859123712 00000100:00100000:1.0:1788873856.753432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788873856.753439:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859123712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753473:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859123712:12345-0@lo:400:kworker.0 Request processed in 34us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873856.753479:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788873856.753499:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124608 00000100:00100000:1.0:1788873856.753502:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124608 00000100:00100000:1.0:1788873856.753529:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124736 00000100:00100000:1.0:1788873856.753532:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124736 00000100:00100000:1.0:1788873856.753551:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788873856.753558:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859124608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753591:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859124608:12345-0@lo:400:kworker.0 Request processed in 35us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873856.753597:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788873856.753607:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788873856.753613:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859124736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753636:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859124736:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873856.753654:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788873856.753666:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873856.753699:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859124608:0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753721:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859123712:0@lo:400:kworker.0 00000100:00100000:1.0:1788873856.753730:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859124736:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.754731:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788873856.754759:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859123584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.754864:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859123584:12345-0@lo:400:kworker.0 Request processed in 120us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873856.754873:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788873856.754950:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124224 00000100:00100000:3.0:1788873856.754956:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124224 00000100:00100000:3.0:1788873856.754997:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788873856.755004:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859124096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.755035:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859124096:12345-0@lo:400:kworker.0 Request processed in 32us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873856.755041:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788873856.755051:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788873856.755057:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859124224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.755083:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859124224:12345-0@lo:400:kworker.0 Request processed in 27us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873856.755104:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788873856.755196:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859123840:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.755248:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859124352:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.755261:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859123456:0@lo:400:kworker.0 00000100:00100000:3.0:1788873856.755274:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859123968:0@lo:400:kworker.0 00010000:00080000:3.0:1788873856.755291:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344194a80 x1875769859124480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873856.755303:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859124480:0@lo:400:kworker.0 00000100:00080000:1.0:1788873856.757129:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788873856.757192:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3344196a00 x1875769859124224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873856.757250:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859124224:0@lo:400:kworker.0 00000100:00100000:2.0:1788873856.757509:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859123584:0@lo:400:kworker.0 00000100:00100000:2.0:1788873856.757524:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859124096:0@lo:400:kworker.0 00000100:00100000:0.0:1788873856.761528:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:3.0:1788873857.136239:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873857.262812:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859124864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873857.262939:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873857.262959:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859124992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873857.262994:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873857.263288:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124992 00000100:00100000:1.0:1788873857.263307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124992 00000100:00100000:0.0:1788873857.263362:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859124864 00000100:00100000:0.0:1788873857.263366:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859124864 00000100:00100000:0.0:1788873857.263402:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788873857.263412:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859124864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873857.263443:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788873857.263473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788873857.263481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859124992:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873857.263490:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859124864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (551us total) trans 0 rc 0/0 00000004:00000024:1.0:1788873857.263505:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873857.263512:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788873857.263577:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859125120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873857.264545:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859124864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873857.265293:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859124992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1810us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873857.265306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788873857.268396:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859124992:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788873857.269612:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788873857.269623:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1788873857.273037:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873857.275072:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125120 00000100:00100000:3.0:1788873857.275087:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125120 00000100:00100000:3.0:1788873857.278126:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788873857.278152:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859125120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873857.278185:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788873857.278338:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859125120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 198us (5311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873857.278346:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788873857.278721:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859125120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873857.672837:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873857.672972:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873857.673037:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873857.673114:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178176 00000100:00100000:2.0:1788873857.673130:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178176 00000100:00100000:2.0:1788873857.673275:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 118 00000100:00100000:2.0:1788873857.673289:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840178176:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873857.673376:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840178176:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 90us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873857.673383:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 118 00000100:00080000:2.0:1788873857.673423:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873857.680292:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873857.680325:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873857.681552:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177920 00000100:00100000:1.0:1788873857.681575:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177920 00000100:00100000:1.0:1788873857.681686:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178432 00000100:00100000:1.0:1788873857.681691:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178432 00000100:00100000:1.0:1788873857.681786:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 311 00000100:00100000:1.0:1788873857.681950:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2399:x1875769840177920:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873857.689314:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178048 00000100:00100000:0.0:1788873857.689340:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178048 00000100:00100000:0.0:1788873857.689444:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 312 00000100:00100000:0.0:1788873857.689461:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840178432:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873857.689624:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2399:x1875769840177920:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 7826us (16801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873857.689650:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 311 00000100:00100000:1.0:1788873857.689680:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 313 00000100:00100000:1.0:1788873857.689692:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840178048:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873857.690573:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873857.690636:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873857.690671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178560 00000100:00100000:3.0:1788873857.690678:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178560 00000100:00100000:3.0:1788873857.690736:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 314 00000100:00100000:3.0:1788873857.690745:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840178560:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873857.690824:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840178560:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873857.690831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 314 00000100:00100000:3.0:1788873857.690862:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178304 00000100:00100000:3.0:1788873857.690865:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178304 00000100:00100000:3.0:1788873857.690899:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 119 00000100:00100000:3.0:1788873857.690907:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840178304:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873857.690945:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840178304:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873857.690953:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 119 00000100:00100000:3.0:1788873857.693346:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840177792 00000100:00100000:3.0:1788873857.693365:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840177792 00000100:00100000:3.0:1788873857.693440:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 383 00000100:00100000:3.0:1788873857.693452:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840177792:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873857.693548:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345fe96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840177792:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 98us (13270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873857.693557:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 383 00000100:00100000:0.0:1788873857.694017:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840178432:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 4560us (20975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873857.694027:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 312 00000100:00080000:0.0:1788873857.694089:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873857.694096:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788873857.694099:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873857.696435:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840178048:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 6730us (16091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873857.696453:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 313 00010000:00010000:0.0:1788873858.158574:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788873858.483726:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788873858.483735:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788873858.483756:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788873858.483764:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788873858.734959:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788873858.966409:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873858.966513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178688 00000100:00100000:3.0:1788873858.966526:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178688 00000100:00100000:3.0:1788873858.966598:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 147 00000100:00100000:3.0:1788873858.966610:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+13:11083:x1875769840178688:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788873858.966736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+13:11083:x1875769840178688:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 Request processed in 128us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873858.966743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 147 00000100:00100000:3.0:1788873858.974303:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873858.974481:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840178816 00000100:00100000:0.0:1788873858.974492:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840178816 00000100:00100000:0.0:1788873858.974569:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 148 00000100:00100000:0.0:1788873858.974583:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:11083:x1875769840178816:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788873858.974698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:11083:x1875769840178816:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873858.974715:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 148 00000100:00100000:1.0:1788873858.980807:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873858.981606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179072 00000100:00100000:2.0:1788873858.981620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179072 00000100:00100000:2.0:1788873858.981697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:2.0:1788873858.981708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+13:11083:x1875769840179072:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788873858.981980:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+14:11083:x1875769840179072:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 273us (1184us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788873858.981998:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 35 00010000:00010000:3.0:1788873859.188285:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873859.253826:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873859.253960:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179200 00000100:00100000:3.0:1788873859.253971:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179200 00000100:00100000:3.0:1788873859.254060:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 149 00000100:00100000:3.0:1788873859.254072:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:11888:x1875769840179200:12345-192.168.202.20@tcp:101:lsof.0 00010000:00010000:3.0:1788873859.254094:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873859.254166:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bfdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97cc expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873859.254289:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873859.254305:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873859.254317:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873859.254367:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788873859.254371:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873859.254415:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873859.254450:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9bfdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873859.254469:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 6 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873859.254478:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:3.0:1788873859.254481:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873859.254485:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873859.254564:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:11888:x1875769840179200:12345-192.168.202.20@tcp:101:lsof.0 Request processed in 494us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873859.254571:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 149 00000100:00080000:0.0:1788873859.254653:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873859.822696:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859125248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873859.822783:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873859.823304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125248 00000100:00100000:3.0:1788873859.823312:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125248 00000100:00100000:3.0:1788873859.823369:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788873859.823380:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859125248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873859.823463:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788873859.823546:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859125248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873859.823553:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788873859.823612:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859125248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788873860.210193:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873861.230967:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873861.358474:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873861.358569:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873861.358698:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125376 00000100:00100000:1.0:1788873861.358706:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125376 00000100:00100000:1.0:1788873861.358959:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788873861.358971:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859125376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873861.359009:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873861.359327:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859125504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873861.359360:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.359403:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125504 00000100:00100000:3.0:1788873861.359414:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125504 00000100:00100000:3.0:1788873861.359437:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788873861.359443:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859125504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873861.359454:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873861.359485:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859125504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873861.359493:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788873861.360234:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859125504:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788873861.360375:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873861.364851:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859125376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5874us (6273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873861.364977:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788873861.366313:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873861.871329:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859125632:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871504:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859126144:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871579:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859126656:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871607:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871633:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788873861.871638:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859125760:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871661:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871678:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859126272:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871720:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859126784:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871775:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859126016:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873861.871816:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859126528:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.871848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873861.872191:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859125888:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872243:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873861.872266:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859126400:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872287:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873861.872299:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859126912:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872319:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873861.872358:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126656 00000100:00100000:0.0:1788873861.872367:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126656 00000100:00100000:0.0:1788873861.872426:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125760 00000100:00100000:0.0:1788873861.872429:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125760 00000100:00100000:0.0:1788873861.872446:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126272 00000100:00100000:0.0:1788873861.872449:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126272 00000100:00100000:0.0:1788873861.872462:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126016 00000100:00100000:0.0:1788873861.872464:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126016 00000100:00100000:0.0:1788873861.872475:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126528 00000100:00100000:0.0:1788873861.872477:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126528 00000100:00100000:0.0:1788873861.872488:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126400 00000100:00100000:0.0:1788873861.872491:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126400 00000100:00100000:0.0:1788873861.872506:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788873861.872516:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859126656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872581:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859126656:12345-0@lo:400:kworker.0 Request processed in 64us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.872588:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788873861.872608:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788873861.872614:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859125760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872668:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859125760:12345-0@lo:400:kworker.0 Request processed in 53us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.872675:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788873861.872688:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788873861.872694:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859126272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872721:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859126272:12345-0@lo:400:kworker.0 Request processed in 28us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.872727:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788873861.872738:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788873861.872744:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859126016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872770:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859126016:12345-0@lo:400:kworker.0 Request processed in 26us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.872776:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788873861.872788:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788873861.872794:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859126528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872820:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875769859126528:12345-0@lo:400:kworker.0 Request processed in 26us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.872826:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788873861.872836:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788873861.872843:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859126400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.872887:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859126400:12345-0@lo:400:kworker.0 Request processed in 45us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.872893:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788873861.872930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126144 00000100:00100000:0.0:1788873861.872934:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126144 00000100:00100000:0.0:1788873861.872971:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125888 00000100:00100000:0.0:1788873861.872974:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125888 00000100:00100000:0.0:1788873861.872989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788873861.872995:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859126144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873034:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859126144:12345-0@lo:400:kworker.0 Request processed in 39us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.873040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788873861.873051:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788873861.873057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859125888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859125888:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.873090:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788873861.873113:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126784 00000100:00100000:0.0:1788873861.873117:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126784 00000100:00100000:0.0:1788873861.873147:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859126912 00000100:00100000:0.0:1788873861.873150:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859126912 00000100:00100000:0.0:1788873861.873171:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788873861.873178:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859126784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873250:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859126784:12345-0@lo:400:kworker.0 Request processed in 73us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.873257:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788873861.873268:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788873861.873274:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859126912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873301:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859126912:12345-0@lo:400:kworker.0 Request processed in 28us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873861.873307:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788873861.873325:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873861.873337:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873861.873340:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873861.873382:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859125760:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873397:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859126272:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873409:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859126784:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873421:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859126144:0@lo:400:kworker.0 00010000:00080000:0.0:1788873861.873436:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475efbb80 x1875769859126656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873861.873447:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859126656:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873507:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859125888:0@lo:400:kworker.0 00010000:00080000:0.0:1788873861.873520:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f4c9880 x1875769859126400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873861.873530:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859126400:0@lo:400:kworker.0 00000100:00100000:0.0:1788873861.873541:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788873861.873549:0:3633:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788873861.873569:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859126912:0@lo:400:kworker.0 00000100:00100000:1.0:1788873861.874019:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859125632 00000100:00100000:1.0:1788873861.874025:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859125632 00000100:00100000:1.0:1788873861.874066:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788873861.874073:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859125632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873861.874145:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859125632:12345-0@lo:400:kworker.0 Request processed in 72us (2715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873861.874164:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788873861.874283:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3465146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859125632:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.874580:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1875769859126528:0@lo:400:kworker.0 00000100:00100000:3.0:1788873861.874605:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859126016:0@lo:400:kworker.0 00000001:00080000:1.0:1788873861.877637:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788873861.877662:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788873861.877828:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788873861.877851:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788873862.255690:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873862.382440:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33442a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859127040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873862.382627:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873862.382742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859127040 00000100:00100000:3.0:1788873862.382753:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859127040 00000100:00100000:3.0:1788873862.382813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788873862.382823:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859127040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873862.382874:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873862.382934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859127040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873862.382942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788873862.383003:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33442a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859127040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873862.384680:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859127168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873862.384764:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873862.385076:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859127168 00000100:00100000:1.0:1788873862.385086:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859127168 00000100:00100000:1.0:1788873862.385152:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788873862.385164:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859127168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873862.385238:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788873862.385349:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859127168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873862.385356:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788873862.389063:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859127296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873862.389162:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873862.389338:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859127296 00000100:00100000:1.0:1788873862.389349:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859127296 00000100:00100000:1.0:1788873862.389416:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788873862.389428:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859127296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873862.389461:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788873862.389529:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859127296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873862.389536:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788873862.389681:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859127296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873862.394745:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859127168:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788873862.446414:0:14506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:24:21 (1788873861) 00000100:00100000:3.0:1788873862.792555:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792606:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792639:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792680:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792703:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792721:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792762:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873862.792801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179328 00000100:00100000:3.0:1788873862.792810:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179328 00000100:00100000:3.0:1788873862.792862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 385 00000100:00100000:2.0:1788873862.792862:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179712 00000100:00100000:2.0:1788873862.792871:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179712 00000100:00100000:3.0:1788873862.792872:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840179328:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873862.792907:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179840 00000100:00100000:2.0:1788873862.792909:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179840 00000100:00100000:2.0:1788873862.792929:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:2.0:1788873862.792936:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840179712:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873862.792939:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840179328:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 69us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873862.792946:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 385 00000100:00100000:2.0:1788873862.792963:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840179712:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873862.792969:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:3.0:1788873862.792975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179456 00000100:00100000:3.0:1788873862.792978:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179456 00000100:00100000:2.0:1788873862.792988:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 123 00000100:00100000:2.0:1788873862.792993:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840179840:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873862.793002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179968 00000100:00100000:3.0:1788873862.793004:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179968 00000100:00100000:3.0:1788873862.793016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840179584 00000100:00100000:2.0:1788873862.793016:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2398:x1875769840179840:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873862.793018:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840179584 00000100:00100000:2.0:1788873862.793022:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 123 00000100:00100000:3.0:1788873862.793031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840180096 00000100:00100000:3.0:1788873862.793033:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840180096 00000100:00080000:2.0:1788873862.793040:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873862.793044:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873862.793047:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 321 00000100:00080000:2.0:1788873862.793047:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873862.793050:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873862.793053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2398:x1875769840179456:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873862.793098:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2398:x1875769840179456:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 44us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873862.793104:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 321 00000100:00100000:3.0:1788873862.793117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 322 00000100:00100000:3.0:1788873862.793123:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2398:x1875769840179968:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873862.793146:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2398:x1875769840179968:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 23us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873862.793152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 322 00000100:00100000:3.0:1788873862.793163:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 323 00000100:00100000:3.0:1788873862.793186:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840179584:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873862.793186:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 324 00000100:00100000:2.0:1788873862.793192:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840180096:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873862.793631:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840179584:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 454us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873862.793638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 323 00000100:00100000:2.0:1788873862.794661:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840180096:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 1462us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873862.794672:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 324 00010000:00010000:0.0:1788873863.278745:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873863.715711:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873863.715747:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840180352 00000100:00100000:1.0:1788873863.715758:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840180352 00000100:00100000:1.0:1788873863.715823:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 150 00000100:00100000:1.0:1788873863.715835:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+13:12157:x1875769840180352:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788873863.715865:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873863.715903:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bfed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.715987:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716000:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716011:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716363:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716372:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716379:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716726:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c002 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716853:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716862:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873863.716873:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788873863.716962:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716983:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716990:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.716996:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873863.717000:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717008:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717020:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d33410dda00) 00010000:00010000:1.0:1788873863.717023:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873863.717360:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717369:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9bff4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717383:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717388:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717393:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717398:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873863.717408:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717414:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717423:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d33410dd800) 00010000:00010000:1.0:1788873863.717426:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873863.717429:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.717433:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9bffb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.719541:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9bfed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97d3 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.719570:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c002 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97d3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.719579:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:1.0:1788873863.719582:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873863.719585:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecac00, rc 0) 00000100:00100000:1.0:1788873863.719936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+15:12157:x1875769840180352:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 4101us (4235us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788873863.719946:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 150 00000100:00100000:1.0:1788873863.733785:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873863.733990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840180480 00000100:00100000:0.0:1788873863.734001:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840180480 00000100:00100000:0.0:1788873863.734075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 151 00000100:00100000:0.0:1788873863.734086:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+15:12157:x1875769840180480:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788873863.734249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+15:12157:x1875769840180480:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 Request processed in 165us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873863.734256:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 151 00000100:00100000:2.0:1788873863.738006:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873863.738150:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840180608 00000100:00100000:1.0:1788873863.738161:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840180608 00000100:00100000:1.0:1788873863.738264:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:1.0:1788873863.738300:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+15:2399:x1875769840180608:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873863.738317:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873863.738345:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c002 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97d3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873863.738364:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:1.0:1788873863.738370:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873863.738421:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+14:2399:x1875769840180608:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 124us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873863.738428:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:2.0:1788873863.755836:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873863.755932:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840180736 00000100:00100000:3.0:1788873863.755943:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840180736 00000100:00100000:3.0:1788873863.756007:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 152 00000100:00100000:3.0:1788873863.756030:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:12157:x1875769840180736:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788873863.756138:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:12157:x1875769840180736:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873863.756146:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 152 00000040:00080000:0.0:1788873863.856021:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788873864.302437:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788873864.624193:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788873864.624216:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788873864.626088:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788873864.626106:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788873864.942562:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873864.942818:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859127424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873864.942891:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873864.943373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859127424 00000100:00100000:2.0:1788873864.943395:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859127424 00000100:00100000:2.0:1788873864.943481:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788873864.943492:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859127424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873864.943526:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788873864.943585:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859127424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873864.943592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788873864.943684:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859127424:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788873865.326577:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873865.656731:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873865.657246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840180864 00000100:00100000:0.0:1788873865.657260:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840180864 00000100:00100000:0.0:1788873865.657348:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 153 00000100:00100000:0.0:1788873865.657360:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+14:12199:x1875769840180864:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873865.657382:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873865.657405:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.657471:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.657485:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.657496:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.657588:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.657597:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.657621:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658059:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658068:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658074:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658139:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873865.658144:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658161:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658175:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:0.0:1788873865.658178:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873865.658183:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658190:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788873865.658598:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788873865.658764:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658772:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658801:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658807:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873865.658809:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658816:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658826:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d33410e1500) 00010000:00010000:0.0:1788873865.658828:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873865.658832:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658838:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c01e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658883:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c010 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97da expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658893:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:0.0:1788873865.658895:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873865.658899:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97da expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.658909:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9a00, rc 0) 00000100:00100000:3.0:1788873865.659977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+14:12199:x1875769840180864:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 2612us (3249us total) trans 0 rc 301/301 00000100:00100000:3.0:1788873865.659988:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 153 00000100:00100000:0.0:1788873865.670598:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873865.670744:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840181120 00000100:00100000:3.0:1788873865.670756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840181120 00000100:00100000:3.0:1788873865.670830:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 154 00000100:00100000:3.0:1788873865.670841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+14:12199:x1875769840181120:12345-192.168.202.20@tcp:36:lfs.0 00010000:00010000:3.0:1788873865.670900:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873865.670926:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93200/0x25c660afb0a9b964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95fe expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.670946:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:3.0:1788873865.670951:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873865.671026:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.671040:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 5 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.671049:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.671093:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 5 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.671108:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 5 pid: 8450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873865.671123:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33442a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859127552:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873865.671756:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873865.677518:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33442a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859127552:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873865.677557:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873865.691444:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873865.691566:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840181248 00000100:00100000:1.0:1788873865.691577:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840181248 00010000:00010000:1.0:1788873865.691639:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 6 pid: 8450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873865.691681:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 80 00000100:00100000:1.0:1788873865.691691:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2401:x1875769840181248:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873865.691705:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873865.691712:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 6 pid: 8450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.691737:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 6 pid: 8450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.691761:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9bfe6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97cc expref: 6 pid: 8450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.691777:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:1.0:1788873865.691794:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.691804:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.691811:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.691843:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873865.691896:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840181248:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 207us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873865.691904:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 80 00000100:00080000:0.0:1788873865.692100:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788873865.692227:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692236:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692260:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692276:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692283:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692898:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692908:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692914:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873865.692925:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da606025 reply state 0000000041523896 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692933:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692937:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873865.692939:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788873865.692942:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788873865.692946:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788873865.692953:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692957:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692962:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692972:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873865.692975:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692981:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692987:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dc000) 00010000:00010000:3.0:1788873865.692988:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873865.692991:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.692995:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c025 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873865.693007:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da606025 reply state 0000000041523896 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.693012:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.693015:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d347650c800) 00010000:00010000:3.0:1788873865.693017:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788873865.693019:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788873865.693077:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+15:12199:x1875769840181120:12345-192.168.202.20@tcp:36:lfs.0 Request processed in 22238us (22491us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788873865.693083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 154 00000100:00100000:0.0:1788873865.804557:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873865.804665:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840181376 00000100:00100000:1.0:1788873865.804675:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840181376 00000100:00100000:1.0:1788873865.804744:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 155 00000100:00100000:1.0:1788873865.804754:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+15:12207:x1875769840181376:12345-192.168.202.20@tcp:101:lctl.0 00010000:00010000:1.0:1788873865.804779:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873865.804803:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c03a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97e1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.804898:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9c041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.804913:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9c041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.804924:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9c041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873865.804974:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788873865.804978:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873865.805001:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9c041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.805027:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c03a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97e1 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.805046:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9c041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97e1 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.805056:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:1.0:1788873865.805059:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788873865.805063:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb400, rc 0) 00000100:00100000:1.0:1788873865.805129:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+16:12207:x1875769840181376:12345-192.168.202.20@tcp:101:lctl.0 Request processed in 375us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873865.805136:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 155 00000100:00100000:0.0:1788873865.926384:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873865.926530:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840181504 00000100:00100000:3.0:1788873865.926542:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840181504 00000100:00100000:3.0:1788873865.926648:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 156 00000100:00100000:3.0:1788873865.926678:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+16:12213:x1875769840181504:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:3.0:1788873865.926702:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873865.926729:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926796:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926812:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926824:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926836:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926843:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926851:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926933:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9c05d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926942:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9c05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.926949:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9c05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873865.927000:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788873865.927005:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873865.927027:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9c05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927040:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927047:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927054:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927060:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873865.927065:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927073:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927087:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:3.0:1788873865.927090:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873865.927095:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927101:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c04f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927115:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927131:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927138:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927155:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873865.927159:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927165:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927174:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d347650c800) 00010000:00010000:3.0:1788873865.927177:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873865.927180:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927186:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927305:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97e8 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927319:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9c05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97e8 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.927327:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873865.927330:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788873865.927338:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443c00, rc 0) 00000100:00100000:3.0:1788873865.927403:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12213:x1875769840181504:12345-192.168.202.20@tcp:101:bash.0 Request processed in 729us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873865.927410:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 156 00000100:00100000:3.0:1788873865.937541:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873865.937677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840181760 00000100:00100000:0.0:1788873865.937688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840181760 00000100:00100000:0.0:1788873865.937753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 157 00000100:00100000:0.0:1788873865.937765:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12213:x1875769840181760:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873865.937789:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873865.937815:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c064 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97ef expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.937999:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938015:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938028:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938057:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938064:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938071:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788873865.938519:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788873865.938657:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938682:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938691:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938726:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938733:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938739:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938745:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873865.938750:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938757:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938769:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873865.938773:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873865.938778:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c06b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873865.938799:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000441c53f6 reply state 00000000ef7fa2ce transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938816:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938823:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:0.0:1788873865.938825:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873865.938828:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788873865.938859:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c064 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938872:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873865.938879:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:0.0:1788873865.938881:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873865.938883:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9800, rc 0) 00000100:00100000:0.0:1788873865.938968:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+20:12213:x1875769840181760:12345-192.168.202.20@tcp:101:bash.0 Request processed in 1204us (1438us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788873865.938976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 157 00000100:00100000:0.0:1788873865.957560:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873865.958342:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840181888 00000100:00100000:2.0:1788873865.958353:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840181888 00000100:00100000:2.0:1788873865.958434:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:2.0:1788873865.958444:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840181888:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873865.958462:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873865.958524:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97f6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788873865.958551:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788873865.958570:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1788873865.958575:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873865.958584:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788873865.958794:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788873865.958832:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873865.958851:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030c00, rc 0) 00000100:00100000:2.0:1788873865.958964:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840181888:12345-192.168.202.20@tcp:101:bash.0 Request processed in 521us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873865.958989:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:2.0:1788873865.965971:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873865.966059:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840182016 00000100:00100000:3.0:1788873865.966068:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840182016 00000100:00100000:3.0:1788873865.966130:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:3.0:1788873865.966139:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:12213:x1875769840182016:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:3.0:1788873865.966170:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873865.966190:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a97fd expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.966249:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.966260:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873865.966265:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873865.966270:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.966304:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873865.966319:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873865.966355:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33442a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875769859127680:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873865.966464:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505029c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873865.968775:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33442a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875769859127680:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873865.968822:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873865.968846:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:2.0:1788873865.968915:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:12213:x1875769840182016:12345-192.168.202.20@tcp:101:bash.0 Request processed in 2776us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873865.968924:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:0.0:1788873865.983108:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873865.983249:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840182144 00000100:00100000:1.0:1788873865.983260:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840182144 00010000:00010000:1.0:1788873865.983312:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873865.983356:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:1.0:1788873865.983366:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840182144:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873865.983383:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873865.983405:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.983420:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.983443:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e7daf1/0x25c660afb0a9c087 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97f6 expref: 7 pid: 8424 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.983461:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873865.983466:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873865.983475:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.983486:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873865.983529:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873865.983558:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344197b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1875769859127808:192.168.202.20@tcp:105: 00000100:00100000:1.0:1788873865.983657:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873865.991858:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344197b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1875769859127808:192.168.202.20@tcp:105: 00010000:00010000:1.0:1788873865.991887:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873865.991951:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2401:x1875769840182144:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 8583us (8854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873865.991963:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:0.0:1788873865.992324:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873865.992625:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840182400 00000100:00100000:2.0:1788873865.992644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840182400 00000100:00100000:2.0:1788873865.992712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:2.0:1788873865.992724:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+20:12213:x1875769840182400:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:2.0:1788873865.993069:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12213:x1875769840182400:12345-192.168.202.20@tcp:35:bash.0 Request processed in 346us (745us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788873865.993077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:0.0:1788873866.118040:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.118256:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840182656 00000100:00100000:2.0:1788873866.118266:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840182656 00000100:00100000:2.0:1788873866.118337:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 158 00000100:00100000:2.0:1788873866.118347:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12223:x1875769840182656:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873866.118375:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873866.118404:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9804 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873866.118533:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788873866.118662:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9804 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.118678:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:2.0:1788873866.118682:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873866.118687:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9804 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.118702:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030a00, rc 0) 00000100:00100000:2.0:1788873866.118775:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+22:12223:x1875769840182656:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 429us (745us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788873866.119189:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 158 00000100:00100000:3.0:1788873866.122541:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.122949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840182912 00000100:00100000:2.0:1788873866.122961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840182912 00000100:00100000:2.0:1788873866.123025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:2.0:1788873866.123036:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+22:12223:x1875769840182912:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873866.123513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12223:x1875769840182912:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 478us (981us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788873866.123522:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:1.0:1788873866.222819:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.222981:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840183040 00000100:00100000:2.0:1788873866.222992:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840183040 00000100:00100000:2.0:1788873866.223061:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 159 00000100:00100000:2.0:1788873866.223073:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12229:x1875769840183040:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873866.223098:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873866.223135:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a980b expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.223255:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c0aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.223272:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.223290:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873866.223337:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788873866.223341:0:8993:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873866.223359:0:8993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.223386:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a980b expref: 25 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.223405:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c0aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a980b expref: 24 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.223413:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873866.223417:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788873866.223421:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030000, rc 0) 00000100:00100000:2.0:1788873866.223486:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12229:x1875769840183040:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 416us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873866.223492:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 159 00000100:00100000:0.0:1788873866.230971:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873866.231074:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840183296 00000100:00100000:1.0:1788873866.231085:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840183296 00000100:00100000:1.0:1788873866.231164:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 160 00000100:00100000:1.0:1788873866.231175:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12229:x1875769840183296:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788873866.231197:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873866.231255:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c0b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9812 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.231385:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c0b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.231403:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.231417:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873866.231430:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788873866.231557:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c0b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9812 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.231577:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9812 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.231587:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:1.0:1788873866.231590:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873866.231594:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca600, rc 0) 00000100:00100000:1.0:1788873866.231675:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+26:12229:x1875769840183296:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 501us (715us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788873866.231682:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 160 00000100:00100000:3.0:1788873866.238658:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.238784:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840183680 00000100:00100000:2.0:1788873866.238805:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840183680 00000100:00100000:2.0:1788873866.238904:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:2.0:1788873866.238915:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+26:2401:x1875769840183680:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873866.238932:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873866.238960:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c0b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9812 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.238994:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:2.0:1788873866.239000:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873866.239066:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+25:2401:x1875769840183680:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 152us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873866.239073:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:0.0:1788873866.253946:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.254037:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840183552 00000100:00100000:3.0:1788873866.254048:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840183552 00000100:00100000:3.0:1788873866.254117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 161 00000100:00100000:3.0:1788873866.254128:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+25:12229:x1875769840183552:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873866.254165:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873866.254192:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c0c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9819 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.254348:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.254364:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.254376:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873866.254389:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788873866.254518:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c0c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9819 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.254537:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9819 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.254558:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:3.0:1788873866.254561:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788873866.254565:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873866.255512:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12229:x1875769840183552:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 648us (838us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788873866.255524:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 161 00000100:00100000:0.0:1788873866.265336:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.265504:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840183808 00000100:00100000:3.0:1788873866.265515:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840183808 00000100:00100000:3.0:1788873866.265575:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:3.0:1788873866.265585:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840183808:12345-192.168.202.20@tcp:1:lfs.0 00010000:00010000:3.0:1788873866.265644:0:8789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.265668:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.265678:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788873866.265683:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873866.265688:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.265765:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.266276:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 6 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873866.266303:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8789:1875769859127936:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873866.266413:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450502b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873866.276838:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.277257:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8789:1875769859127936:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873866.277286:0:8789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873866.277459:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840183936 00000100:00100000:0.0:1788873866.277482:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840183936 00002000:00100000:0.0:1788873866.277548:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d3344194700 x1875769840183936/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:282/0 lens 504/0 e 0 to 0 dl 1788873877 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788873866.277565:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3344194700 with x1875769840183936 ext(0->12) 00010000:00010000:0.0:1788873866.277573:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 7 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873866.277588:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 7 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788873866.277604:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d3344194700 00000100:00100000:0.0:1788873866.277653:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:0.0:1788873866.277671:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840183936:12345-192.168.202.20@tcp:4:lfs.0 00000100:00100000:0.0:1788873866.280540:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840183936:12345-192.168.202.20@tcp:4:lfs.0 Request processed in 2860us (3702us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788873866.280554:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 2 00002000:00100000:0.0:1788873866.280567:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d3344194700 x1875769840183936/t4294967306(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:282/0 lens 504/448 e 0 to 0 dl 1788873877 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788873866.280585:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3344194700 with x1875769840183936 ext(0->12) 00010000:00010000:0.0:1788873866.280596:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 9 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873866.280630:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 9 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788873866.280657:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d3344194700 00000100:00100000:0.0:1788873866.292352:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.293413:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840184064 00000100:00100000:2.0:1788873866.293424:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840184064 00010000:00010000:2.0:1788873866.293476:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 9 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.293526:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 82 00000100:00100000:2.0:1788873866.293537:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2399:x1875769840184064:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873866.293551:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788873866.293568:0:9516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788873866.293571:0:9516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788873866 00002000:00010000:2.0:1788873866.293573:0:9516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788873867 00002000:00010000:2.0:1788873866.293576:0:9516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788873866 00002000:00010000:2.0:1788873866.293578:0:9516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788873866.293584:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 9 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.293616:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 9 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.293641:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383b4c81/0x25c660afb0a9c08e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97fd expref: 9 pid: 8427 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.293659:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873866.293663:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873866.293669:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.293680:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.293717:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873866.293790:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2399:x1875769840184064:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 254us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873866.293798:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 82 00010000:00010000:3.0:1788873866.294040:0:8789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294051:0:8789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294073:0:8789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294081:0:8789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294088:0:8789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294094:0:8789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873866.294099:0:8789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294120:0:8789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294133:0:8789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.294150:0:8789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2ef6192/0x25c660afb0a9c0db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873866.294200:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840183808:12345-192.168.202.20@tcp:1:lfs.0 Request processed in 28616us (28876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.294256:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:1.0:1788873866.301019:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873866.304731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840184320 00000100:00100000:0.0:1788873866.304748:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840184320 00000100:00100000:0.0:1788873866.304835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 38 00000100:00100000:0.0:1788873866.304846:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12229:x1875769840184320:12345-192.168.202.20@tcp:35:lfs.0 00000004:00010000:0.0:1788873866.304928:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9819 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873866.305171:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788873866.305247:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788873866.305612:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788873866.305652:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873866.305667:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873866.305677:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873866.305711:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873866.305727:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 31 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873866.305765:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3451802d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875769859128064:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873866.305872:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873866.315608:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.315713:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840184448 00000100:00100000:3.0:1788873866.315714:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3451802d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875769859128064:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873866.315723:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840184448 00010000:00010000:3.0:1788873866.315749:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315769:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 32 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.315820:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 83 00000100:00100000:2.0:1788873866.315829:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+32:2401:x1875769840184448:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873866.315858:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873866.315865:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 32 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315878:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 32 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315901:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a97ef expref: 32 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315917:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:2.0:1788873866.315922:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315932:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315940:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.315959:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873866.316007:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.316012:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+31:2401:x1875769840184448:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 182us (426us total) trans 0 rc 0/0 00010000:00010000:3.0:1788873866.316023:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.316026:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 83 00000001:00080000:3.0:1788873866.316161:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788873866.316312:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788873866.316405:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859128192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788873866.316459:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873866.316503:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450502600 going to sleep for 11 seconds 00000100:00100000:0.0:1788873866.316553:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859128192 00000100:00100000:0.0:1788873866.316559:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859128192 00000100:00100000:0.0:1788873866.316613:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788873866.316621:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875769859128192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788873866.316702:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875769859128192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873866.316709:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788873866.316787:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859128192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788873866.316889:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788873866.316924:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344195880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859128320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788873866.316950:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.316974:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873866.317017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859128320 00000100:00100000:3.0:1788873866.317023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859128320 00000100:00080000:2.0:1788873866.317111:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873866.317260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788873866.317270:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875769859128320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788873866.317380:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1875769859128320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (429us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788873866.317387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788873866.317727:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344195880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875769859128320:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788873866.317763:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788873866.317804:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.317822:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.317829:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.317835:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873866.317839:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.317847:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.317861:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:2.0:1788873866.317863:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788873866.317867:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.317873:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c0e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873866.317955:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788873866.318014:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788873866.318024:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403263818479ns, next at 404263816881ns, rc = 0 00000001:00080000:2.0:1788873866.318029:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788873866.318047:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410e1c00) 00010000:00010000:2.0:1788873866.318050:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788873866.318056:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9819 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.318165:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+34:12229:x1875769840184320:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 13320us (17160us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788873866.318173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 38 00000020:00080000:2.0:1788873866.318177:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788873866.333590:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.333679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840184576 00000100:00100000:3.0:1788873866.333689:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840184576 00000100:00100000:3.0:1788873866.333752:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 162 00000100:00100000:3.0:1788873866.333764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+34:12229:x1875769840184576:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873866.333789:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873866.333818:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c0e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9820 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.333880:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9820 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.333897:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9820 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.333915:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.333918:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873866.333922:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442e00, rc 0) 00000100:00100000:3.0:1788873866.333989:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+35:12229:x1875769840184576:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 228us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.333996:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 162 00000100:00100000:1.0:1788873866.338329:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.338469:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840184832 00000100:00100000:2.0:1788873866.338479:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840184832 00000100:00100000:2.0:1788873866.338536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 39 00000100:00100000:2.0:1788873866.338547:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+35:12229:x1875769840184832:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873866.338775:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+36:12229:x1875769840184832:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 229us (457us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788873866.338783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 39 00010000:00010000:1.0:1788873866.350380:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873866.465337:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.465460:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840185088 00000100:00100000:2.0:1788873866.465471:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840185088 00000100:00100000:2.0:1788873866.465537:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 163 00000100:00100000:2.0:1788873866.465548:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+36:12239:x1875769840185088:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873866.465581:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873866.465606:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c0f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9827 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873866.465724:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788873866.465861:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c0f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9827 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.465877:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:2.0:1788873866.465880:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873866.465904:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c0f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9827 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.465920:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030a00, rc 0) 00000100:00100000:2.0:1788873866.465980:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12239:x1875769840185088:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 434us (653us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788873866.465986:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 163 00000100:00100000:0.0:1788873866.471758:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.471866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840185216 00000100:00100000:3.0:1788873866.471876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840185216 00000100:00100000:3.0:1788873866.471950:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 164 00000100:00100000:3.0:1788873866.471962:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12239:x1875769840185216:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:3.0:1788873866.472062:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472084:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472097:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472110:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472118:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472125:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472245:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472253:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472260:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873866.472310:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472344:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472351:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472358:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472364:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873866.472369:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472378:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472391:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873866.472394:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873866.472399:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472405:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c0fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472418:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472424:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472429:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472441:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873866.472445:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472451:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472459:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:3.0:1788873866.472461:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873866.472464:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472471:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472481:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472487:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472492:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472496:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873866.472499:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472504:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472521:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.472523:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873866.472527:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.472533:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c10c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873866.472625:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12239:x1875769840185216:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 665us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.472634:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 164 00000100:00100000:1.0:1788873866.476266:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.476367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840185472 00000100:00100000:2.0:1788873866.476377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840185472 00000100:00100000:2.0:1788873866.476437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:2.0:1788873866.476449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12239:x1875769840185472:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873866.476697:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+38:12239:x1875769840185472:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 249us (489us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788873866.476705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:1.0:1788873866.478707:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859128448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788873866.478827:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873866.479044:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859128448 00000100:00100000:3.0:1788873866.479052:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859128448 00000100:00100000:3.0:1788873866.479115:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788873866.479125:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859128448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873866.479157:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873866.479236:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859128448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.479243:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1788873866.479345:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873866.479648:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859128448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873866.480101:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873866.480118:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859128576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873866.480175:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.480415:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859128576 00000100:00100000:1.0:1788873866.480436:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859128576 00000100:00100000:1.0:1788873866.480484:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788873866.480493:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34770df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859128576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873866.480511:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873866.480561:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34770df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859128576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.480568:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788873866.481127:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859128576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788873866.547777:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.547948:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840185728 00000100:00100000:3.0:1788873866.547961:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840185728 00000100:00100000:3.0:1788873866.548038:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 165 00000100:00100000:3.0:1788873866.548050:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+38:12242:x1875769840185728:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873866.548080:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873866.548123:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c113 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a982e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548262:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548280:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548293:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548306:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548314:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548320:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548458:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548467:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548474:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873866.548483:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788873866.548564:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548583:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548590:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548596:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873866.548600:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548609:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548622:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873866.548626:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873866.548631:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548638:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c11a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548652:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548657:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548663:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548668:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873866.548678:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548684:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548692:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:3.0:1788873866.548695:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873866.548698:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548705:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c121 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548745:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c113 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 41 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548760:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 40 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.548766:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.548768:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873866.548772:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873866.548849:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+40:12242:x1875769840185728:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 801us (1082us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788873866.548857:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 165 00000100:00100000:0.0:1788873866.556093:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.556188:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840185856 00000100:00100000:3.0:1788873866.556199:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840185856 00000100:00100000:3.0:1788873866.556288:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 166 00000100:00100000:3.0:1788873866.556300:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+40:12242:x1875769840185856:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:3.0:1788873866.556402:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556421:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556433:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556468:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556475:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556481:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556486:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873866.556491:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556498:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556510:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.556513:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873866.556519:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.556526:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873866.556615:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+40:12242:x1875769840185856:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 316us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.556622:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 166 00000100:00100000:1.0:1788873866.559613:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.559731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840186112 00000100:00100000:2.0:1788873866.559743:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840186112 00000100:00100000:2.0:1788873866.559806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:2.0:1788873866.559827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+40:12242:x1875769840186112:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873866.560078:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+41:12242:x1875769840186112:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 262us (474us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788873866.560085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:0.0:1788873866.876786:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.877263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840186368 00000100:00100000:3.0:1788873866.877277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840186368 00000100:00100000:3.0:1788873866.877355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 167 00000100:00100000:3.0:1788873866.877368:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+41:12273:x1875769840186368:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:3.0:1788873866.877405:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873866.877436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c13d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9835 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.877603:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.877621:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.877638:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873866.877654:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788873866.877791:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c13d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9835 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.878069:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9835 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.878082:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.878105:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873866.878112:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873866.880327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12273:x1875769840186368:12345-192.168.202.20@tcp:101:cat.0 Request processed in 2942us (3537us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788873866.880344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 167 00000100:00100000:0.0:1788873866.888114:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.888675:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840186624 00000100:00100000:2.0:1788873866.888692:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840186624 00000100:00100000:2.0:1788873866.888781:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:2.0:1788873866.888823:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12273:x1875769840186624:12345-192.168.202.20@tcp:35:cat.0 00000100:00100000:2.0:1788873866.890078:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+44:12273:x1875769840186624:12345-192.168.202.20@tcp:35:cat.0 Request processed in 1252us (1968us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788873866.890093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:0.0:1788873866.898017:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.898173:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840186752 00000100:00100000:3.0:1788873866.898192:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840186752 00000100:00100000:3.0:1788873866.898341:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:3.0:1788873866.898355:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+44:2398:x1875769840186752:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873866.898376:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873866.898746:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9835 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.898774:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.898782:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873866.899057:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+43:2398:x1875769840186752:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 703us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.899068:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:0.0:1788873866.949475:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873866.951338:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840187008 00000100:00100000:2.0:1788873866.951357:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840187008 00000100:00100000:2.0:1788873866.951459:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 168 00000100:00100000:2.0:1788873866.951470:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12279:x1875769840187008:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:2.0:1788873866.951502:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873866.951506:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788873866.951539:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c0aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a980b expref: 43 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.951564:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873866.951570:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873866.951585:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c152 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a983c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.951959:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.951974:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 43 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.951983:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.952025:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 43 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.952057:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 43 pid: 8450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.952072:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3344132300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875769859128704:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873866.952481:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345119fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873866.963705:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.963800:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840187136 00000100:00100000:3.0:1788873866.963815:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840187136 00010000:00010000:3.0:1788873866.963867:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 44 pid: 8450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873866.963915:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 84 00000100:00100000:3.0:1788873866.963925:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+44:2400:x1875769840187136:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873866.963941:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873866.963948:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 44 pid: 8450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.963975:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 44 pid: 8450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.963997:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.964003:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.964013:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.964021:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.964042:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873866.964253:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c128 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a982e expref: 44 pid: 8450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873866.964282:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3344132300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875769859128704:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873866.964307:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.964317:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.964323:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873866.964342:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788873866.964502:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c152 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 45 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.964518:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873866.964526:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:2.0:1788873866.964538:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788873866.964541:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3440030400, rc 0) 00000100:00100000:3.0:1788873866.964616:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+44:2400:x1875769840187136:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 690us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873866.964625:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 84 00000100:00100000:2.0:1788873866.965689:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12279:x1875769840187008:12345-192.168.202.20@tcp:101:dd.0 Request processed in 14215us (16222us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788873866.965699:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 168 00000100:00100000:0.0:1788873866.971111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873866.973402:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840187264 00000100:00100000:1.0:1788873866.973418:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840187264 00000100:00100000:1.0:1788873866.973533:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 169 00000100:00100000:1.0:1788873866.973543:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12279:x1875769840187264:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:1.0:1788873866.973567:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873866.973590:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c167 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9843 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.973637:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.973651:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.973663:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.973802:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.973847:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873866.973856:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873866.973859:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788873866.973863:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca200, rc 0) 00000100:00100000:1.0:1788873866.973936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+44:12279:x1875769840187264:12345-192.168.202.20@tcp:101:dd.0 Request processed in 394us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.973944:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 169 00000100:00100000:0.0:1788873866.978603:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873866.978902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840187520 00000100:00100000:3.0:1788873866.978918:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840187520 00000100:00100000:3.0:1788873866.979029:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 170 00000100:00100000:3.0:1788873866.979041:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33427d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+44:12279:x1875769840187520:12345-192.168.202.20@tcp:36:dd.0 00010000:00010000:3.0:1788873866.979395:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.979420:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.979435:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788873866.979495:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788873866.979521:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002611c708 reply state 00000000fccd2423 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.979562:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873866.979571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873866.979574:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788873866.979580:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788873866.979948:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33427d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+47:12279:x1875769840187520:12345-192.168.202.20@tcp:36:dd.0 Request processed in 906us (1355us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788873866.979956:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 170 00000020:00080000:3.0:1788873866.979961:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788873866.992319:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859128960:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992396:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873866.992427:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859129472:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992450:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873866.992481:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859129984:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992508:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873866.992536:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788873866.992542:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859129088:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992581:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873866.992596:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859129600:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992616:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873866.992644:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859130112:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992668:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873866.992697:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129984 00000100:00100000:0.0:1788873866.992705:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129984 00000100:00100000:0.0:1788873866.992750:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859130112 00000100:00100000:0.0:1788873866.992753:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859130112 00000100:00100000:0.0:1788873866.992774:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788873866.992784:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859129984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992840:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859129984:12345-0@lo:400:kworker.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873866.992848:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788873866.992867:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788873866.992873:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859130112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992899:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859130112:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873866.992906:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788873866.992946:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859130112:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992957:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859129984:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.992981:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859128960 00000100:00100000:0.0:1788873866.992993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859128960 00000100:00100000:0.0:1788873866.993017:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129472 00000100:00100000:0.0:1788873866.993020:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129472 00000100:00100000:0.0:1788873866.993036:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129600 00000100:00100000:0.0:1788873866.993039:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129600 00000100:00100000:0.0:1788873866.993054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788873866.993060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859128960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.993097:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859128960:12345-0@lo:400:kworker.0 Request processed in 37us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873866.993103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788873866.993115:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788873866.993121:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859129472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.993164:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859129472:12345-0@lo:400:kworker.0 Request processed in 43us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873866.993170:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788873866.993180:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788873866.993186:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859129600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.993239:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859129600:12345-0@lo:400:kworker.0 Request processed in 54us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873866.993244:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00080000:0.0:1788873866.993273:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbd180 x1875769859129600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873866.993285:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859129600:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.993296:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859128960:0@lo:400:kworker.0 00000100:00100000:0.0:1788873866.993305:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859129472:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993499:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859128832:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993545:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.993586:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859129344:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993611:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.993630:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859129856:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.993670:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788873866.993677:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859129216:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993697:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.993723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859129728:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993741:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873866.993763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859128832 00000100:00100000:1.0:1788873866.993767:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859128832 00000100:00100000:1.0:1788873866.993794:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788873866.993800:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859128832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993854:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859128832:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.993860:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788873866.993887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129088 00000100:00100000:1.0:1788873866.993890:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129088 00000100:00100000:1.0:1788873866.993912:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129344 00000100:00100000:1.0:1788873866.993914:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129344 00000100:00100000:1.0:1788873866.993926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788873866.993932:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859129088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.993969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859129088:12345-0@lo:400:kworker.0 Request processed in 36us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.993975:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788873866.993984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788873866.993989:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859129344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994011:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859129344:12345-0@lo:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.994016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788873866.994037:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859128832:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994046:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859129344:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994070:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859129088:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994088:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129856 00000100:00100000:1.0:1788873866.994091:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129856 00000100:00100000:1.0:1788873866.994106:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129216 00000100:00100000:1.0:1788873866.994109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129216 00000100:00100000:1.0:1788873866.994116:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859129728 00000100:00100000:1.0:1788873866.994118:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859129728 00000100:00100000:1.0:1788873866.994152:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788873866.994158:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875769859129856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994192:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875769859129856:12345-0@lo:400:kworker.0 Request processed in 35us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.994198:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00080000:1.0:1788873866.994247:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334401aa00 x1875769859129856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873866.994257:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859129856:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994272:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788873866.994278:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859129216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994309:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859129216:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.994315:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788873866.994334:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859129216:0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994348:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788873866.994353:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859129728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873866.994381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859129728:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873866.994387:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788873866.994405:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859129728:0@lo:400:kworker.0 00000100:00080000:2.0:1788873866.996884:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873866.996893:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788873866.996896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873867.249088:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873867.249284:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840187648 00000100:00100000:1.0:1788873867.249297:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840187648 00000100:00100000:1.0:1788873867.249375:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 171 00000100:00100000:1.0:1788873867.249391:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+47:12293:x1875769840187648:12345-192.168.202.20@tcp:101:stat.0 00010000:00010000:1.0:1788873867.249439:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873867.249465:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c17c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a984a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249537:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249553:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249567:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249579:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249586:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249594:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249677:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249688:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 48 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249708:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249745:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 48 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.249766:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 48 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873867.249779:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859130240:192.168.202.20@tcp:104: 00000100:00080000:2.0:1788873867.249916:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873867.250018:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873867.261417:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859130240:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873867.261452:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873867.261516:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.261610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840187904 00000100:00100000:2.0:1788873867.261618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840187904 00000100:00100000:2.0:1788873867.261686:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:2.0:1788873867.261697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+49:6172:x1875769840187904:12345-192.168.202.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788873867.262016:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+50:6172:x1875769840187904:12345-192.168.202.20@tcp:35:ldlm_bl.0 Request processed in 320us (812us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788873867.262025:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:0.0:1788873867.266461:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873867.267373:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840188032 00000100:00100000:1.0:1788873867.267389:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840188032 00010000:00010000:1.0:1788873867.267456:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 50 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873867.267571:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 85 00000100:00100000:1.0:1788873867.267583:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+50:2400:x1875769840188032:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873867.267604:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873867.267612:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 50 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.267627:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 50 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.267656:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c159 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a983c expref: 50 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.267681:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873867.267688:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.267720:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.267729:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.267766:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873867.267866:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+49:2400:x1875769840188032:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 284us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873867.267875:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 85 00010000:00010000:0.0:1788873867.268180:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268193:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.268297:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788873867.268303:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873867.268331:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268344:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268352:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268358:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268362:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268366:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873867.268370:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268386:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268397:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873867.268399:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873867.268402:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268407:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c183 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268418:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268422:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268426:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268429:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873867.268431:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268434:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268438:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:0.0:1788873867.268439:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873867.268442:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268456:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c18a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268497:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c17c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a984a expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268509:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a984a expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.268515:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873867.268517:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873867.268518:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecbc00, rc 0) 00000100:00100000:0.0:1788873867.268558:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+48:12293:x1875769840187648:12345-192.168.202.20@tcp:101:stat.0 Request processed in 19174us (19494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873867.268563:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 171 00000100:00100000:0.0:1788873867.332603:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.332685:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840188288 00000100:00100000:2.0:1788873867.332703:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840188288 00000100:00100000:2.0:1788873867.332795:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 172 00000100:00100000:2.0:1788873867.332929:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+48:12299:x1875769840188288:12345-192.168.202.20@tcp:36:truncate.0 00010000:00010000:2.0:1788873867.333021:0:8993:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873867.333056:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a984a expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873867.333083:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:2.0:1788873867.333090:0:8993:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873867.333460:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873867.333496:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873867.333510:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788873867.333563:0:8993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788873867.333584:0:8993:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001327b666 reply state 000000006f1cba96 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873867.333599:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873867.333612:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:2.0:1788873867.333615:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788873867.333618:0:8993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788873867.333757:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+50:12299:x1875769840188288:12345-192.168.202.20@tcp:36:truncate.0 Request processed in 950us (1162us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788873867.333767:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 172 00000020:00080000:2.0:1788873867.333773:0:8993:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788873867.374546:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873867.472728:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.473008:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840188416 00000100:00100000:0.0:1788873867.473025:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840188416 00000100:00100000:0.0:1788873867.473109:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 173 00000100:00100000:0.0:1788873867.473122:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+50:12313:x1875769840188416:12345-192.168.202.20@tcp:101:stat.0 00010000:00010000:0.0:1788873867.473163:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.473194:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c19f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9851 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473335:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473378:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473393:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473409:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473417:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473424:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473526:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473536:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473544:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.473599:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788873867.473604:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873867.473767:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473783:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473927:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473934:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473943:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473950:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873867.473955:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473964:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473980:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873867.473983:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873867.473990:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.473997:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474013:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474020:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474026:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474038:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873867.474041:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474048:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474057:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:0.0:1788873867.474059:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873867.474063:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474070:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474110:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c19f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 52 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474126:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 51 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.474146:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873867.474148:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873867.474151:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8800, rc 0) 00000100:00100000:0.0:1788873867.474376:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+51:12313:x1875769840188416:12345-192.168.202.20@tcp:101:stat.0 Request processed in 1256us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873867.474387:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 173 00000100:00100000:3.0:1788873867.504199:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859130368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873867.504327:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873867.504438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859130368 00000100:00100000:3.0:1788873867.504447:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859130368 00000100:00100000:3.0:1788873867.504509:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788873867.504519:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859130368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873867.504565:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873867.504622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859130368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873867.504629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788873867.504684:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859130368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873867.506452:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859130496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873867.506534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873867.506745:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859130496 00000100:00100000:0.0:1788873867.506772:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859130496 00000100:00100000:0.0:1788873867.506837:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788873867.506847:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859130496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788873867.506882:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788873867.506943:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859130496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873867.506950:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788873867.507097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859130496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873867.507284:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873867.507294:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859130624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873867.507330:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873867.507413:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859130624 00000100:00100000:1.0:1788873867.507418:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859130624 00000100:00100000:1.0:1788873867.507455:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788873867.507463:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859130624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873867.507475:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788873867.507512:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859130624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873867.507518:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788873867.507548:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859130624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873867.563810:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.564026:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840188672 00000100:00100000:0.0:1788873867.564038:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840188672 00000100:00100000:0.0:1788873867.564106:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 174 00000100:00100000:0.0:1788873867.564115:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+51:12323:x1875769840188672:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873867.564151:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.564182:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9858 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.564353:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788873867.564459:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9858 expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.564474:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:0.0:1788873867.564476:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788873867.564481:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9858 expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.564493:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8600, rc 0) 00000100:00100000:0.0:1788873867.564554:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+52:12323:x1875769840188672:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 441us (762us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788873867.564570:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 174 00000100:00100000:2.0:1788873867.567601:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.567835:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840188928 00000100:00100000:3.0:1788873867.567846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840188928 00000100:00100000:3.0:1788873867.567903:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:3.0:1788873867.567914:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+52:12323:x1875769840188928:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873867.568151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+53:12323:x1875769840188928:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 239us (558us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788873867.568160:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:2.0:1788873867.622048:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.622354:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840189184 00000100:00100000:0.0:1788873867.622369:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840189184 00000100:00100000:0.0:1788873867.622452:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 175 00000100:00100000:0.0:1788873867.622466:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+53:12329:x1875769840189184:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873867.622502:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.622531:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a985f expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.622927:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.622949:0:8993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 54 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.622960:0:8993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.623004:0:8993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 54 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.623021:0:8993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 54 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873867.623039:0:8993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8993:1875769859130752:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873867.623186:0:8993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873867.626609:0:8993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8993:1875769859130752:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873867.626691:0:8993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873867.627578:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.627686:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840189312 00000100:00100000:3.0:1788873867.627698:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840189312 00010000:00010000:3.0:1788873867.627752:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 55 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873867.627819:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 86 00000100:00100000:3.0:1788873867.627832:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+55:2400:x1875769840189312:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873867.627852:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873867.627860:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 55 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.627877:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 55 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.627916:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8800/0x25c660afb0a9c1b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9851 expref: 55 pid: 6509 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.627939:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873867.627944:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.627968:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.627978:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.628015:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873867.628093:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:2400:x1875769840189312:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 264us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873867.628102:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 86 00010000:00010000:0.0:1788873867.628676:0:8993:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.628688:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.628717:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788873867.628925:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 55 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.628947:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 54 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.628957:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873867.628960:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788873867.628964:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9400, rc 0) 00000100:00100000:0.0:1788873867.629017:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+54:12329:x1875769840189184:12345-192.168.202.20@tcp:101:bash.0 Request processed in 6554us (6988us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788873867.629026:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 175 00000100:00100000:2.0:1788873867.633017:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.633235:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840189568 00000100:00100000:0.0:1788873867.633249:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840189568 00000100:00100000:0.0:1788873867.633335:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 176 00000100:00100000:0.0:1788873867.633348:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+54:12329:x1875769840189568:12345-192.168.202.20@tcp:36:bash.0 00010000:00010000:0.0:1788873867.633680:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.633728:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.633744:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873867.633797:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788873867.633820:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da6c2a5b reply state 000000001bf96e10 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.633835:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.633844:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873867.633847:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873867.633852:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873867.633979:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+57:12329:x1875769840189568:12345-192.168.202.20@tcp:36:bash.0 Request processed in 633us (976us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788873867.633988:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 176 00000020:00080000:0.0:1788873867.633994:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788873867.638712:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.638798:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840189696 00000100:00100000:0.0:1788873867.638820:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840189696 00000100:00100000:0.0:1788873867.638909:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 177 00000100:00100000:0.0:1788873867.638923:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+57:12329:x1875769840189696:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873867.638960:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.638992:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9866 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.639123:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.639172:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 58 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.639184:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.639426:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 58 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.639440:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 58 pid: 8993 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873867.639454:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859130880:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873867.639548:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873867.642138:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33435d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875769859130880:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873867.642180:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873867.642819:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.643340:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840189824 00000100:00100000:3.0:1788873867.643351:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840189824 00010000:00010000:3.0:1788873867.643402:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 59 pid: 8993 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873867.643447:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 87 00000100:00100000:3.0:1788873867.643457:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+59:2401:x1875769840189824:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873867.643476:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873867.643484:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 59 pid: 8993 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.643500:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 59 pid: 8993 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.643525:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9400/0x25c660afb0a9c1d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a985f expref: 59 pid: 8993 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.643566:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873867.643571:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.643581:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.643588:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.643623:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873867.643690:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+58:2401:x1875769840189824:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 234us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873867.643695:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 87 00010000:00010000:0.0:1788873867.644115:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.644125:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.644722:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788873867.644727:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873867.644755:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.644813:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9866 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.644833:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9866 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.644843:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873867.644846:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873867.644850:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9a00, rc 0) 00000100:00100000:0.0:1788873867.644911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+57:12329:x1875769840189696:12345-192.168.202.20@tcp:101:bash.0 Request processed in 5993us (6217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873867.644918:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 177 00000100:00100000:2.0:1788873867.648183:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.648577:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840190080 00000100:00100000:0.0:1788873867.648594:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840190080 00000100:00100000:0.0:1788873867.648762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:0.0:1788873867.648775:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+57:12329:x1875769840190080:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:0.0:1788873867.649485:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+58:12329:x1875769840190080:12345-192.168.202.20@tcp:35:bash.0 Request processed in 708us (1311us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788873867.649497:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:3.0:1788873867.730456:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.730580:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840190336 00000100:00100000:0.0:1788873867.730594:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840190336 00000100:00100000:0.0:1788873867.730833:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 178 00000100:00100000:0.0:1788873867.730848:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+58:12339:x1875769840190336:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873867.730882:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.730921:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a986d expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.731082:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788873867.731258:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a986d expref: 60 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.731276:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:0.0:1788873867.731281:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788873867.731287:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c1f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a986d expref: 60 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.731304:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8600, rc 0) 00000100:00100000:0.0:1788873867.731394:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12339:x1875769840190336:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 549us (953us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788873867.731402:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 178 00000100:00100000:2.0:1788873867.734121:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.734246:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840190464 00000100:00100000:3.0:1788873867.734259:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840190464 00000100:00100000:3.0:1788873867.734331:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 179 00000100:00100000:3.0:1788873867.734344:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12339:x1875769840190464:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:3.0:1788873867.734442:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734464:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734478:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734492:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734513:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734521:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734633:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734644:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734653:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873867.734712:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734728:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734735:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734742:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734749:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873867.734755:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734765:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.734785:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873867.734789:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873867.734796:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735077:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c201 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735098:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735106:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735113:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735118:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873867.735121:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735138:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735148:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:3.0:1788873867.735151:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873867.735154:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735161:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735183:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735189:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735196:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735200:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873867.735364:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735373:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735382:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873867.735385:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873867.735388:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.735395:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c20f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873867.735537:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12339:x1875769840190464:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 1193us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873867.735548:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 179 00000100:00100000:2.0:1788873867.739106:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.739471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840190720 00000100:00100000:3.0:1788873867.739484:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840190720 00000100:00100000:3.0:1788873867.739555:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:3.0:1788873867.739588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12339:x1875769840190720:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873867.740051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:12339:x1875769840190720:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 461us (957us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788873867.740060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:2.0:1788873867.812533:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.812671:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840190976 00000100:00100000:0.0:1788873867.812685:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840190976 00000100:00100000:0.0:1788873867.812767:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 180 00000100:00100000:0.0:1788873867.812780:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33442a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+60:12342:x1875769840190976:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873867.812825:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.812855:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c216 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9874 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.813512:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.813538:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.813583:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.813598:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.813606:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.813614:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.814773:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c22b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815051:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815068:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873867.815100:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788873867.815386:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815397:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815405:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815412:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873867.815418:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815427:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815442:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:1.0:1788873867.815447:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873867.815452:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815458:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9200/0x25c660afb0a9c21d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815476:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815484:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815502:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815508:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873867.815511:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815518:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815526:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:1.0:1788873867.815530:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873867.815533:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815540:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815602:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9874 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815739:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9874 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.815749:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873867.815751:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873867.815755:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecbc00, rc 0) 00000100:00100000:1.0:1788873867.816180:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33442a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+62:12342:x1875769840190976:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 3399us (3660us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788873867.816268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 180 00000100:00100000:2.0:1788873867.829893:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873867.830035:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840191104 00000100:00100000:1.0:1788873867.830050:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840191104 00000100:00100000:1.0:1788873867.830151:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:1.0:1788873867.830165:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+62:2401:x1875769840191104:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873867.830190:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873867.830275:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9c22b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9874 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873867.830303:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873867.830311:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873867.830389:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+61:2401:x1875769840191104:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 226us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873867.830398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:2.0:1788873867.835349:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.835848:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840191232 00000100:00100000:3.0:1788873867.835862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840191232 00000100:00100000:3.0:1788873867.836077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 181 00000100:00100000:3.0:1788873867.836091:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+61:12342:x1875769840191232:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:3.0:1788873867.836349:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836378:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836394:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836444:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836453:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836460:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836468:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873867.836475:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836508:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836519:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873867.836522:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873867.836527:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873867.836532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c239 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873867.837893:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3465145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+61:12342:x1875769840191232:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 1789us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873867.837981:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 181 00000100:00100000:2.0:1788873867.839885:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873867.839948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840191488 00000100:00100000:3.0:1788873867.839964:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840191488 00000100:00100000:3.0:1788873867.840042:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:3.0:1788873867.840054:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+61:12342:x1875769840191488:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873867.840434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+62:12342:x1875769840191488:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 381us (563us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788873867.840443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:2.0:1788873867.919834:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.919885:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.919918:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.919951:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.919987:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840192128 00000100:00100000:2.0:1788873867.919999:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840192128 00000100:00080000:2.0:1788873867.920035:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873867.920087:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840191744 00000100:00100000:2.0:1788873867.920089:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840191744 00000100:00080000:2.0:1788873867.920099:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873867.920120:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 331 00000100:00100000:2.0:1788873867.920143:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840192128:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873867.920396:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 332 00000100:00100000:3.0:1788873867.920407:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840191744:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873867.920503:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840192128:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 363us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873867.920512:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 331 00000100:00100000:0.0:1788873867.920609:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840191872 00000100:00100000:0.0:1788873867.920613:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840191872 00000100:00100000:0.0:1788873867.920652:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 126 00000100:00100000:0.0:1788873867.920658:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840191872:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873867.921189:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840191616 00000100:00100000:1.0:1788873867.921196:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840191616 00000100:00100000:1.0:1788873867.921259:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 387 00000100:00100000:1.0:1788873867.921265:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840191616:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873867.925423:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2399:x1875769840191744:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 4992us (5443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873867.925445:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 332 00000100:00100000:2.0:1788873867.925457:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.925531:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840192000 00000100:00100000:2.0:1788873867.925544:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840192000 00000100:00100000:3.0:1788873867.925608:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873867.925622:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 127 00000100:00100000:3.0:1788873867.925634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840192256 00000100:00100000:2.0:1788873867.925636:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3344194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840192000:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873867.925640:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840192256 00000100:00100000:3.0:1788873867.925683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 333 00000100:00100000:3.0:1788873867.925691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840192256:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873867.925710:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2399:x1875769840192000:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873867.925719:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 127 00000100:00100000:3.0:1788873867.925944:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2399:x1875769840192256:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 252us (335us total) trans 0 rc 0/0 00000100:00080000:2.0:1788873867.925945:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873867.925953:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873867.925957:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 333 00000100:00080000:2.0:1788873867.925958:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873867.926260:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3344196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840191872:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 5598us (6370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873867.926270:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 126 00000100:00100000:1.0:1788873867.928565:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2399:x1875769840191616:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 7281us (8730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873867.928586:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 387 00000100:00100000:2.0:1788873867.998539:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873867.998684:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840192512 00000100:00100000:0.0:1788873867.998699:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840192512 00000100:00100000:0.0:1788873867.998849:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 182 00000100:00100000:0.0:1788873867.998864:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+62:12361:x1875769840192512:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:0.0:1788873867.998907:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873867.998941:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a987b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.999104:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c247 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.999157:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c247 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.999174:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c247 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873867.999190:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788873867.999382:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a987b expref: 65 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.999408:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c247 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a987b expref: 64 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873867.999420:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873867.999424:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788873867.999430:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8000, rc 0) 00000100:00100000:0.0:1788873867.999577:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+64:12361:x1875769840192512:12345-192.168.202.20@tcp:101:cat.0 Request processed in 716us (1059us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788873867.999586:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 182 00000100:00100000:2.0:1788873868.017912:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.019329:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840192640 00000100:00100000:0.0:1788873868.019347:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840192640 00000100:00100000:0.0:1788873868.019510:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 183 00000100:00100000:0.0:1788873868.019525:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+64:12362:x1875769840192640:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788873868.019561:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873868.019593:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9882 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.019727:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c25c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.019745:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.019760:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873868.019834:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788873868.019839:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873868.019864:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.020045:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9882 expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.020077:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c25c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9882 expref: 65 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.020088:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873868.020092:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788873868.020096:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8200, rc 0) 00000100:00100000:0.0:1788873868.020247:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12362:x1875769840192640:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 682us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873868.020255:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 183 00000100:00100000:2.0:1788873868.027891:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.028013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193024 00000100:00100000:3.0:1788873868.028028:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193024 00000100:00100000:3.0:1788873868.028111:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 48 00000100:00100000:3.0:1788873868.028136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12362:x1875769840193024:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873868.030132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12362:x1875769840193024:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 1988us (2239us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788873868.030147:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 48 00000100:00100000:2.0:1788873868.034638:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873868.034765:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193152 00000100:00100000:1.0:1788873868.034779:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193152 00000100:00100000:1.0:1788873868.034868:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:1.0:1788873868.034881:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12362:x1875769840193152:12345-192.168.202.20@tcp:103:lfs.0 00010000:00010000:1.0:1788873868.035134:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788873868.035172:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c1ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9866 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.035355:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c247 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a987b expref: 65 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.035375:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c0e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9820 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.035388:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873868.035395:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873868.035473:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+63:12362:x1875769840193152:12345-192.168.202.20@tcp:103:lfs.0 Request processed in 595us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873868.035483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:1.0:1788873868.037065:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.037152:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193280 00000100:00100000:3.0:1788873868.037163:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193280 00000100:00100000:3.0:1788873868.037256:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 184 00000100:00100000:3.0:1788873868.037269:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+63:12362:x1875769840193280:12345-192.168.202.20@tcp:58:lfs.0 00010000:00010000:3.0:1788873868.037457:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.037479:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.037494:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873868.049600:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788873868.049731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+63:12362:x1875769840193280:12345-192.168.202.20@tcp:58:lfs.0 Request processed in 12460us (12669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873868.049744:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 184 00000100:00100000:0.0:1788873868.092741:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.092881:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193408 00000100:00100000:2.0:1788873868.092894:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193408 00000100:00100000:2.0:1788873868.093012:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 185 00000100:00100000:2.0:1788873868.093025:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33435d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+63:12364:x1875769840193408:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873868.093050:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873868.093098:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9c26a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9889 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.093290:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.093306:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.093322:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.093333:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.093340:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.093347:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.093972:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.093984:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094000:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873868.094044:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788873868.094048:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873868.094068:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094081:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094089:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094095:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094101:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094106:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873868.094110:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094117:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094140:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873868.094143:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873868.094148:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094163:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030a00/0x25c660afb0a9c271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094181:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094187:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094193:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094197:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873868.094200:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094291:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094300:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:3.0:1788873868.094303:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873868.094306:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094311:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030000/0x25c660afb0a9c278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094342:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030c00/0x25c660afb0a9c26a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 65 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094372:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 64 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.094398:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873868.094400:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873868.094403:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873868.094480:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33435d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+64:12364:x1875769840193408:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1457us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.094488:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 185 00010000:00010000:0.0:1788873868.398528:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873868.719907:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873868.719916:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873868.720070:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788873868.720078:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788873868.720293:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859131008:192.168.202.20@tcp:107:hsm_cdtr.0 00000001:00080000:2.0:1788873868.727790:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1788873868.727839:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788873868.727853:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3342b820c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788873868.727858:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d33427a5800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3342b82b40 00000020:00080000:2.0:1788873868.727861:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d33427a5d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d33441e6000 00010000:00010000:2.0:1788873868.727931:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.727944:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.727969:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.727976:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873868.727980:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.727988:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728015:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d347650c800) 00010000:00010000:2.0:1788873868.728018:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873868.728031:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728039:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c02c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728061:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728067:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728073:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728078:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873868.728081:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728096:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728104:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873868.728107:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873868.728109:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728125:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c033 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728141:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728147:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728153:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728158:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873868.728160:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728166:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728173:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1500) 00010000:00010000:2.0:1788873868.728175:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873868.728178:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728188:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c072 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728218:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728224:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728230:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728235:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873868.728237:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728243:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728250:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:2.0:1788873868.728252:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873868.728255:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728261:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c175 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728269:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728275:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728285:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728289:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3440030400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873868.728292:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728298:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728305:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:2.0:1788873868.728306:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873868.728309:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728314:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030400/0x25c660afb0a9c198 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728332:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728339:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728345:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728349:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873868.728352:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728365:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728373:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:2.0:1788873868.728375:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873868.728377:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.728383:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c1de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788873868.728787:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788873868.728852:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788873868.728869:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859131136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788873868.728937:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873868.731724:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873868.732156:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859131136 00000100:00100000:2.0:1788873868.732169:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859131136 00000100:00100000:2.0:1788873868.737745:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788873868.737780:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1875769859131136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788873868.737949:0:8424:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788873868.737990:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa00c8a, atime: 0x6aa00c8b, ctime: 0x6aa00c8a, blocks: 0x8 00010000:00010000:2.0:1788873868.737999:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.738016:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1788873868.738127:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873868.738141:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.738176:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.738190:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.738199:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.738250:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788873868.740086:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3634:x1875769859131136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2319us (11140us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788873868.740099:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1788873868.740160:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873868.740168:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.740180:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873868.740185:0:10332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.740197:0:10332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.740233:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.740255:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf666ba/0x25c660afb0a9c286 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.740276:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873868.740278:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873868.740279:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788873868.740584:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343991500/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788873868.740592:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859131136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788873868.742770:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859131008:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788873868.744957:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873868.768360:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.768592:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193536 00000100:00100000:2.0:1788873868.768603:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193536 00000100:00100000:2.0:1788873868.768679:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 186 00000100:00100000:2.0:1788873868.768689:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12375:x1875769840193536:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788873868.768721:0:6509:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788873868.768994:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12375:x1875769840193536:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 305us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873868.769003:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 186 00000100:00100000:0.0:1788873868.793141:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873868.793455:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193664 00000100:00100000:1.0:1788873868.793466:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193664 00000100:00100000:1.0:1788873868.793530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 187 00000100:00100000:1.0:1788873868.793541:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12375:x1875769840193664:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788873868.793635:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793654:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793666:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793718:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793727:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793735:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793765:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793774:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.793781:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873868.794035:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788873868.794040:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873868.794056:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794075:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794081:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794089:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794096:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873868.794101:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794109:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794133:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:1.0:1788873868.794137:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873868.794142:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794148:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9c28d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794160:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794167:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794173:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794185:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873868.794188:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794195:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794224:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873868.794227:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873868.794231:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794237:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c294 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794251:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794257:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794263:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794268:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873868.794272:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794278:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794298:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873868.794300:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873868.794304:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.794309:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c29b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873868.794988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12375:x1875769840193664:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 Request processed in 1445us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873868.794998:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 187 00000100:00100000:2.0:1788873868.802653:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.802759:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840193920 00000100:00100000:3.0:1788873868.802769:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840193920 00000100:00100000:3.0:1788873868.802841:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 188 00000100:00100000:3.0:1788873868.802851:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+17:12375:x1875769840193920:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873868.802871:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873868.802894:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9890 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803004:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803019:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803032:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873868.803043:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788873868.803129:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803149:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803155:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803160:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873868.803166:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803174:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803187:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873868.803190:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873868.803195:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803201:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803526:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2a2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9890 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803537:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:3.0:1788873868.803539:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873868.803544:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9890 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.803553:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873868.805169:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12375:x1875769840193920:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 2309us (2516us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788873868.805182:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 188 00000100:00100000:3.0:1788873868.813229:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873868.813432:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840194048 00000100:00100000:1.0:1788873868.813442:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840194048 00000100:00100000:1.0:1788873868.813504:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 189 00000100:00100000:1.0:1788873868.813515:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12375:x1875769840194048:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788873868.813553:0:8993:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788873868.813687:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12375:x1875769840194048:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 173us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873868.813696:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 189 00000100:00100000:3.0:1788873868.842708:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.843041:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840194304 00000100:00100000:2.0:1788873868.843051:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840194304 00000100:00100000:2.0:1788873868.843107:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 190 00000100:00100000:2.0:1788873868.843128:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12375:x1875769840194304:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788873868.843152:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873868.843156:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788873868.843182:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c25c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9882 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.843222:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873868.843242:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873868.843257:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c2b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9897 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873868.843685:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788873868.843853:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c2be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.843868:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.843880:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.843935:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c2b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9897 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.843951:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c2be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9897 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.843960:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3476dc6500) 00010000:00010000:2.0:1788873868.843963:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873868.843966:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873868.844035:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840194304:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 918us (1336us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788873868.844044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 190 00000100:00100000:1.0:1788873868.864938:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.865014:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840194560 00000100:00100000:3.0:1788873868.865024:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840194560 00000100:00100000:3.0:1788873868.865077:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 191 00000100:00100000:3.0:1788873868.865087:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840194560:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788873868.865160:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873868.865190:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c2be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9897 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865229:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3476dc6500) 00010000:00010000:3.0:1788873868.865241:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873868.865263:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865278:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865288:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865355:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865363:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865381:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865424:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865431:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865437:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865443:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873868.865448:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865455:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865464:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873868.865467:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873868.865471:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865477:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865486:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865492:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865503:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865508:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873868.865510:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865516:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865524:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xb1f30551 (ffff9d3454571000) 00010000:00010000:3.0:1788873868.865527:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873868.865530:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.865536:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb1f30551 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873868.865751:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12375:x1875769840194560:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 664us (822us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788873868.865759:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 191 00000100:00100000:1.0:1788873868.870464:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.870553:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840194688 00000100:00100000:3.0:1788873868.870564:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840194688 00000100:00100000:3.0:1788873868.870635:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 192 00000100:00100000:3.0:1788873868.870646:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12375:x1875769840194688:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873868.870668:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873868.870691:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a989e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.870755:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.870771:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.870785:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.871168:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c2da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.871188:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.871198:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:3.0:1788873868.871200:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788873868.871229:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873868.871291:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840194688:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 647us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.871298:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 192 00000100:00100000:2.0:1788873868.874585:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873868.875156:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840194944 00000100:00100000:1.0:1788873868.875167:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840194944 00000100:00100000:1.0:1788873868.875253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 193 00000100:00100000:1.0:1788873868.875264:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840194944:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788873868.875429:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.875458:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.875470:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873868.875677:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788873868.875688:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405821482438ns, next at 406821479624ns, rc = 0 00000004:00010000:1.0:1788873868.875738:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b8d749d reply state 000000007a7ae9a1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.875752:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.875760:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:1.0:1788873868.875764:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788873868.875767:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873868.877086:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12375:x1875769840194944:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 1815us (2501us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788873868.877096:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 193 00000100:00100000:3.0:1788873868.883968:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.884628:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840195072 00000100:00100000:0.0:1788873868.884639:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840195072 00000100:00100000:0.0:1788873868.884791:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 194 00000100:00100000:0.0:1788873868.884803:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12375:x1875769840195072:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873868.884831:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873868.884856:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98a5 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.884920:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 22 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.884936:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 22 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.884955:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:0.0:1788873868.884958:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873868.884963:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9800, rc 0) 00000100:00100000:0.0:1788873868.885029:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+22:12375:x1875769840195072:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 228us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873868.885037:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 194 00000100:00100000:3.0:1788873868.888289:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.888619:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840195200 00000100:00100000:0.0:1788873868.888629:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840195200 00000100:00100000:0.0:1788873868.888693:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:0.0:1788873868.888704:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+6:2400:x1875769840195200:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788873868.888939:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840195200:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 237us (661us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788873868.888957:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:3.0:1788873868.894965:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.895557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840195456 00000100:00100000:2.0:1788873868.895568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840195456 00000100:00100000:2.0:1788873868.895644:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 49 00000100:00100000:2.0:1788873868.895654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+22:12375:x1875769840195456:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788873868.895890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12375:x1875769840195456:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 236us (932us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788873868.895898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 49 00000100:00100000:1.0:1788873868.899310:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.899558:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840195712 00000100:00100000:3.0:1788873868.899569:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840195712 00000100:00100000:3.0:1788873868.899631:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 195 00000100:00100000:3.0:1788873868.899640:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12375:x1875769840195712:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788873868.899780:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12375:x1875769840195712:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 140us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.899788:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 195 00000100:00100000:2.0:1788873868.908338:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.908543:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840195840 00000100:00100000:0.0:1788873868.908556:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840195840 00000100:00100000:0.0:1788873868.908619:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 196 00000100:00100000:0.0:1788873868.908630:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12375:x1875769840195840:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873868.908651:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873868.908676:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c2f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98ac expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.908749:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c2fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.908765:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.908778:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873868.908829:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873868.908849:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.908875:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c2f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ac expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.908890:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c2fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ac expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.908899:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:0.0:1788873868.908909:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788873868.908914:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9000, rc 0) 00000100:00100000:0.0:1788873868.908978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12375:x1875769840195840:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 349us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873868.908984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 196 00000100:00100000:0.0:1788873868.913661:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.913728:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840195968 00000100:00100000:2.0:1788873868.913738:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840195968 00000100:00100000:0.0:1788873868.913817:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:0.0:1788873868.913829:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840195968:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873868.913848:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873868.913871:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98b3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788873868.913898:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa00c8d, blocks: 0x0 00010000:00010000:0.0:1788873868.913918:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788873868.913923:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873868.913933:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.913951:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.913962:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8200, rc 0) 00000100:00100000:0.0:1788873868.914009:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840195968:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 184us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873868.914016:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:2.0:1788873868.917754:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.919502:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840196224 00000100:00100000:0.0:1788873868.919533:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840196224 00000100:00100000:0.0:1788873868.919609:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 197 00000100:00100000:0.0:1788873868.919620:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12375:x1875769840196224:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788873868.919742:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12375:x1875769840196224:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 123us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873868.919750:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 197 00000100:00100000:2.0:1788873868.923099:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.925531:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840196352 00000100:00100000:0.0:1788873868.925548:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840196352 00000100:00100000:0.0:1788873868.925617:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:0.0:1788873868.925629:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:12375:x1875769840196352:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873868.925647:0:8789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873868.925665:0:8789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98ba expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.925700:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.925709:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873868.925714:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873868.925720:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 9 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.925756:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.925770:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873868.925791:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859131264:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873868.925896:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873868.931518:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859131264:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873868.931566:0:8789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 9 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.931593:0:8789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9c00, rc 0) 00000100:00100000:0.0:1788873868.931663:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+9:12375:x1875769840196352:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 6035us (8572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873868.931672:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:2.0:1788873868.932222:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.932259:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840196480 00000100:00100000:2.0:1788873868.932266:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840196480 00010000:00010000:2.0:1788873868.932301:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873868.932337:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 88 00000100:00100000:2.0:1788873868.932347:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840196480:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873868.932360:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873868.932392:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.932406:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.932431:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba91a5d/0x25c660afb0a9c304 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98b3 expref: 9 pid: 8427 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.932453:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873868.932457:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873868.932465:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 8 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.932475:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 8 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873868.932510:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 8 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873868.932525:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875769859131392:192.168.202.20@tcp:105: 00000100:00100000:2.0:1788873868.932591:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345119fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873868.944787:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875769859131392:192.168.202.20@tcp:105: 00010000:00010000:3.0:1788873868.944818:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873868.944879:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840196480:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 12532us (12658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.944889:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 88 00000100:00100000:2.0:1788873868.948384:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873868.948780:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840196608 00000100:00100000:0.0:1788873868.948800:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840196608 00002000:00100000:0.0:1788873868.948862:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d3343990000 x1875769840196608/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:284/0 lens 504/0 e 0 to 0 dl 1788873879 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788873868.948875:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3343990000 with x1875769840196608 ext(0->8) 00002000:00010000:0.0:1788873868.948882:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3343990000 00000100:00100000:0.0:1788873868.948919:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:0.0:1788873868.948930:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2399:x1875769840196608:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788873868.952040:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2399:x1875769840196608:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 Request processed in 3096us (3653us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788873868.952054:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00002000:00100000:0.0:1788873868.952069:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d3343990000 x1875769840196608/t4294967315(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:284/0 lens 504/448 e 0 to 0 dl 1788873879 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788873868.952087:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3343990000 with x1875769840196608 ext(0->8) 00002000:00010000:0.0:1788873868.952093:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3343990000 00000100:00100000:0.0:1788873868.965367:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.965731:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840196736 00000100:00100000:2.0:1788873868.965741:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840196736 00000100:00100000:2.0:1788873868.965805:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 198 00000100:00100000:2.0:1788873868.965816:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12375:x1875769840196736:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788873868.967728:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788873868.967744:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788873868.967773:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788873868.968070:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873868.968091:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859131520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788873868.968169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873868.968237:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859131520 00000100:00100000:2.0:1788873868.968245:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859131520 00000100:00100000:2.0:1788873868.968292:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788873868.968301:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859131520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788873868.968432:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788873868.968436:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788873869 00002000:00010000:2.0:1788873868.968439:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788873868.968441:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788873869 -> 1788873869 00002000:00010000:2.0:1788873868.968444:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788873868.968486:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859131520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (316us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788873868.968494:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1788873868.968543:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343993800/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788873868.968549:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859131520:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788873868.968614:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1788873868.968669:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788873868.968683:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788873868.968801:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+20:12375:x1875769840196736:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 Request processed in 2977us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.968810:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 198 00000100:00100000:0.0:1788873868.971598:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.971742:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840196864 00000100:00100000:3.0:1788873868.971754:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840196864 00000100:00100000:3.0:1788873868.971824:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:3.0:1788873868.971836:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2401:x1875769840196864:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788873868.973340:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.973355:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.973363:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.973383:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873868.973388:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.973396:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.973413:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:1.0:1788873868.973417:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788873868.973421:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.973428:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c2e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788873868.974951:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788873868.976336:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788873868.976347:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788873868.976519:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840196864:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 Request processed in 4678us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.976530:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:2.0:1788873868.980371:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.980476:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840197120 00000100:00100000:3.0:1788873868.980503:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840197120 00000100:00100000:3.0:1788873868.980568:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 199 00000100:00100000:3.0:1788873868.980577:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840197120:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788873868.980647:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873868.980677:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c2fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ac expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.980700:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:3.0:1788873868.980706:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873868.980745:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.980759:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.980769:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788873868.980907:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b507b3dc reply state 00000000fce22341 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.980920:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.980928:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:3.0:1788873868.980931:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788873868.980933:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788873868.981048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+20:12375:x1875769840197120:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 471us (690us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788873868.981056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 199 00000100:00100000:0.0:1788873868.986189:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873868.986375:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840197248 00000100:00100000:2.0:1788873868.986386:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840197248 00000100:00100000:2.0:1788873868.986442:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:2.0:1788873868.986452:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840197248:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788873868.986604:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788873868.986608:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788873869 -> 1788873868 00002000:00010000:2.0:1788873868.986622:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788873867 00002000:00010000:2.0:1788873868.986624:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788873869 -> 1788873868 00002000:00010000:2.0:1788873868.986627:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788873868.986687:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840197248:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 236us (508us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788873868.986694:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:0.0:1788873868.990249:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873868.990380:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840197504 00000100:00100000:1.0:1788873868.990394:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840197504 00000100:00100000:1.0:1788873868.990468:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 200 00000100:00100000:1.0:1788873868.990480:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+20:12375:x1875769840197504:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788873868.990583:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.990616:0:8993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.990630:0:8993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.990678:0:8993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873868.990713:0:8993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 20 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873868.990728:0:8993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8993:1875769859131648:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788873868.990822:0:8993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873868.997760:0:8993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8993:1875769859131648:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873868.997808:0:8993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873868.998568:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873868.998780:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840197632 00000100:00100000:3.0:1788873868.998788:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840197632 00010000:00010000:3.0:1788873868.998827:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 21 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873868.998870:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 89 00000100:00100000:3.0:1788873868.998880:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+21:2401:x1875769840197632:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873868.998895:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873868.998903:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 21 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.998916:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 21 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.998939:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c2e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a989e expref: 21 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.998955:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:3.0:1788873868.998960:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.998970:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.998978:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873868.999012:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873868.999070:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+20:2401:x1875769840197632:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 192us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873868.999089:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 89 00010000:00010000:0.0:1788873868.999354:0:8993:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999362:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999411:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999419:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999426:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999432:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873868.999437:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999445:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999468:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:0.0:1788873868.999470:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788873868.999474:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873868.999481:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c319 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873868.999535:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840197504:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 Request processed in 9058us (9342us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788873868.999545:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 200 00000100:00100000:0.0:1788873869.016038:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.016200:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840197760 00000100:00100000:1.0:1788873869.016227:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840197760 00000100:00100000:1.0:1788873869.016296:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:1.0:1788873869.016306:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840197760:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788873869.016351:0:8789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.016372:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 8 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.016381:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873869.016385:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788873869.016390:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.016427:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 8 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.016450:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 8 pid: 8789 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.016465:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859131776:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788873869.016550:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b829c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788873869.016711:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873869.020971:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8789:1875769859131776:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873869.021005:0:8789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.023344:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873869.024009:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840197888 00000100:00100000:2.0:1788873869.024029:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840197888 00010000:00010000:2.0:1788873869.024071:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 9 pid: 8789 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.024132:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 90 00000100:00100000:2.0:1788873869.024143:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840197888:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873869.024159:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873869.024183:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 9 pid: 8789 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.024197:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 9 pid: 8789 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.024237:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb9c5bc/0x25c660afb0a9c30b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98ba expref: 9 pid: 8789 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.024250:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873869.024254:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873869.024261:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.024270:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.024305:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873869.024361:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840197888:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 220us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873869.024377:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 90 00010000:00010000:0.0:1788873869.024495:0:8789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024505:0:8789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024525:0:8789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024533:0:8789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024542:0:8789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024556:0:8789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873869.024561:0:8789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024570:0:8789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024582:0:8789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.024589:0:8789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b0739f/0x25c660afb0a9c320 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.024655:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840197760:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 Request processed in 8348us (8624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873869.024663:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:2.0:1788873869.037892:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.038071:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840198144 00000100:00100000:1.0:1788873869.038085:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840198144 00000100:00100000:1.0:1788873869.038184:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 201 00000100:00100000:1.0:1788873869.038197:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12375:x1875769840198144:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788873869.038317:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.038338:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.038348:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.038383:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.038415:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 19 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.038430:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859131904:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788873869.038525:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b829c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788873869.038588:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788873869.042813:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859131904:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873869.042848:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.042967:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873869.044683:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840198272 00000100:00100000:3.0:1788873869.044694:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840198272 00010000:00010000:3.0:1788873869.044737:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 20 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873869.044796:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 91 00000100:00100000:3.0:1788873869.044807:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+20:2401:x1875769840198272:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873869.044822:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873869.044830:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 20 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.044844:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 20 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.044871:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9c16e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9843 expref: 20 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.044891:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:3.0:1788873869.044898:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.044908:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.044932:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.044963:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873869.045033:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+19:2401:x1875769840198272:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 228us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873869.045041:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 91 00010000:00010000:2.0:1788873869.045233:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.045243:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.045611:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.045626:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.045634:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.045664:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.045678:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 19 pid: 8993 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.045691:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859132032:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873869.045758:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345119fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873869.056450:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.056556:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840198400 00000100:00100000:1.0:1788873869.056566:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840198400 00010000:00010000:1.0:1788873869.056616:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 20 pid: 8993 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.056655:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 92 00000100:00100000:1.0:1788873869.056666:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+20:2400:x1875769840198400:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873869.056688:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873869.056695:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 20 pid: 8993 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.056710:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 20 pid: 8993 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.056736:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:1.0:1788873869.056742:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.056752:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.056780:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.056988:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873869.057052:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+20:2400:x1875769840198400:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 386us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873869.057060:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 92 00010000:00010000:1.0:1788873869.057233:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c2ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98a5 expref: 19 pid: 8993 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.057251:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859132032:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873869.057272:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.057282:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.057289:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788873869.057895:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788873869.058074:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788873869.058129:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788873869.058893:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859132160:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788873869.059040:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873869.059603:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873869.067408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859132160 00000100:00100000:0.0:1788873869.067427:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859132160 00000100:00100000:0.0:1788873869.067522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788873869.067535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8450:x1875769859132160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788873869.067704:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8450:x1875769859132160:12345-0@lo:1000:mdt00_003.0 Request processed in 171us (8664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873869.067713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788873869.067809:0:8450:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788873869.067817:0:8450:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343993800, transno 4294967316 00000100:00100000:0.0:1788873869.067854:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859132160:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788873869.068045:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788873869.068136:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859132288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788873869.068179:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873869.068221:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788873869.068236:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859132288 00000100:00100000:0.0:1788873869.068240:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859132288 00000100:00100000:0.0:1788873869.068265:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788873869.068270:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d345884c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8450:x1875769859132288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788873869.068356:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d345884c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1875769859132288:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (176us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788873869.068362:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788873869.068791:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859132288:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788873869.068834:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068843:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068851:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068856:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.068861:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068869:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068900:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:0.0:1788873869.068903:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873869.068908:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068914:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c32e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068939:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068947:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068953:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068958:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.068961:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068967:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068975:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873869.068977:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873869.068980:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.068986:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c263 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.069020:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.069034:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.069042:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.069066:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.069080:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 22 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.069091:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859132416:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873869.069175:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873869.076632:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859132416:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873869.076673:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.077358:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.078637:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840198528 00000100:00100000:1.0:1788873869.078651:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840198528 00010000:00010000:1.0:1788873869.078697:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 23 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.078742:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 93 00000100:00100000:1.0:1788873869.078751:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+23:2400:x1875769840198528:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873869.078765:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873869.078772:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 23 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.078785:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 23 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.078819:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c27f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9889 expref: 23 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.078833:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:1.0:1788873869.078839:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.078849:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.078857:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.078890:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873869.078933:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.078952:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.078961:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2400:x1875769840198528:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 211us (1607us total) trans 0 rc 0/0 00010000:00010000:0.0:1788873869.078964:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.078968:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 93 00010000:00010000:0.0:1788873869.078971:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.078988:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.078994:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.078999:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079007:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079017:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873869.079019:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873869.079022:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079028:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c335 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079038:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079044:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079049:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079054:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.079057:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079072:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079081:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d347650cf00) 00010000:00010000:0.0:1788873869.079084:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788873869.079087:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.079092:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c327 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.079263:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12375:x1875769840198144:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 41068us (41380us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788873869.079272:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 201 00000020:00080000:0.0:1788873869.079275:0:8450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788873869.080905:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873869.080913:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873869.081410:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788873869.081419:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788873869.094972:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873869.095251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840198784 00000100:00100000:2.0:1788873869.095261:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840198784 00000100:00100000:2.0:1788873869.095327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:2.0:1788873869.095337:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12375:x1875769840198784:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788873869.095623:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788873869.095661:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788873869.095699:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.095717:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.095731:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.095741:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.095748:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.095754:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.095777:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788873869.095946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12375:x1875769840198784:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 609us (982us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788873869.095954:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 50 00000020:00080000:2.0:1788873869.095959:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788873869.099197:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873869.099236:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.099248:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ee00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788873869.099252:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.099262:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.099282:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:1.0:1788873869.099287:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788873869.099293:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.099299:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c33c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.099315:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873869.099317:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873869.099319:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873869.255768:0:14653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873869.255779:0:14653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873869.255818:0:14653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788873869.255824:0:14653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788873869.425305:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873869.432612:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873869.432695:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840199040 00000100:00100000:3.0:1788873869.432706:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840199040 00000100:00100000:3.0:1788873869.432766:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 202 00000100:00100000:3.0:1788873869.432777:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+23:12385:x1875769840199040:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873869.432801:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873869.432824:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98c1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.432940:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c34a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.432955:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.432967:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873869.432979:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788873869.433081:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c1 expref: 26 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.433099:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c34a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c1 expref: 25 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.433155:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873869.433158:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788873869.433163:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788873869.433271:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+25:12385:x1875769840199040:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 495us (668us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788873869.433279:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 202 00000100:00100000:2.0:1788873869.437703:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.437781:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840199168 00000100:00100000:1.0:1788873869.437791:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840199168 00000100:00100000:1.0:1788873869.437869:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 203 00000100:00100000:1.0:1788873869.437881:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+25:12385:x1875769840199168:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:1.0:1788873869.437975:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.437994:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438008:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438025:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438031:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438038:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438152:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438161:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438168:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788873869.438279:0:8993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438298:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438305:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438313:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438318:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873869.438323:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438412:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438427:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:1.0:1788873869.438430:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873869.438435:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438441:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c358 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438456:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438462:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438475:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438480:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873869.438483:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438490:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438498:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873869.438501:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873869.438504:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438510:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c35f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438526:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438533:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438539:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438544:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecae00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873869.438547:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438563:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438571:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddb00) 00010000:00010000:1.0:1788873869.438573:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873869.438576:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.438582:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c366 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.438666:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+25:12385:x1875769840199168:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 787us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873869.438675:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 203 00000100:00100000:3.0:1788873869.523262:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.523421:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840199424 00000100:00100000:1.0:1788873869.523434:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840199424 00000100:00100000:1.0:1788873869.523534:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 204 00000100:00100000:1.0:1788873869.523545:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+25:12388:x1875769840199424:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788873869.523567:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873869.523592:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c36d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98c8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523697:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523714:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523727:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523753:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523760:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523766:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523887:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523895:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523903:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873869.523913:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788873869.523988:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.523995:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524001:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524006:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873869.524010:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524028:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524040:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:1.0:1788873869.524043:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873869.524048:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524054:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524066:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524072:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524077:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524083:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873869.524086:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524091:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524097:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410ddb00) 00010000:00010000:1.0:1788873869.524100:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873869.524102:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524132:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c37b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524173:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c36d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524186:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.524194:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873869.524196:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873869.524198:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb000, rc 0) 00000100:00100000:1.0:1788873869.524288:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12388:x1875769840199424:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 744us (1036us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788873869.524297:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 204 00000100:00100000:2.0:1788873869.530518:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.530688:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840199552 00000100:00100000:1.0:1788873869.530698:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840199552 00000100:00100000:1.0:1788873869.530763:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 205 00000100:00100000:1.0:1788873869.530774:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12388:x1875769840199552:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:1.0:1788873869.530852:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530870:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530882:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530932:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530939:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530946:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530952:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecac00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873869.530957:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530965:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530977:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873869.530981:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788873869.530985:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.530992:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c390 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.531061:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12388:x1875769840199552:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 289us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873869.531070:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 205 00000100:00100000:2.0:1788873869.538599:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873869.538707:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840199808 00000100:00100000:3.0:1788873869.538721:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840199808 00000100:00100000:3.0:1788873869.538773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:3.0:1788873869.538782:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12388:x1875769840199808:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873869.539001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+28:12388:x1875769840199808:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 219us (412us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788873869.539008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:3.0:1788873869.590617:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873869.590814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200064 00000100:00100000:2.0:1788873869.590840:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200064 00000100:00100000:2.0:1788873869.590944:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 206 00000100:00100000:2.0:1788873869.590964:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+28:11918:x1875769840200064:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873869.591010:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873869.591048:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c397 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.591335:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.591353:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.591363:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.591402:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.591419:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 29 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.591435:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859132544:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873869.591618:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873869.598817:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873869.598949:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859132544:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873869.598988:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.599017:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200192 00000100:00100000:1.0:1788873869.599029:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200192 00010000:00010000:1.0:1788873869.599088:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 30 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.599174:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 94 00000100:00100000:1.0:1788873869.599187:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+30:2400:x1875769840200192:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873869.599261:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873869.599272:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 30 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.599287:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 30 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.599317:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c8 expref: 30 pid: 8450 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.599337:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873869.599343:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.599355:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.599364:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.599397:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873869.599426:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.599435:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.599467:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+29:2400:x1875769840200192:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 282us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873869.599476:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 94 00000004:00200000:3.0:1788873869.599478:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788873869.599686:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c397 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.599705:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.599713:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:3.0:1788873869.599716:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788873869.599718:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215e800, rc 0) 00000100:00100000:3.0:1788873869.599757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+29:11918:x1875769840200064:12345-192.168.202.20@tcp:101:bash.0 Request processed in 8802us (9161us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788873869.599765:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 206 00000100:00100000:2.0:1788873869.607023:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.610076:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200320 00000100:00100000:1.0:1788873869.610139:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200320 00000100:00100000:1.0:1788873869.610278:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 207 00000100:00100000:2.0:1788873869.610538:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+29:11918:x1875769840200320:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873869.610594:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873869.610637:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98d6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.610684:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c3b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.610703:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.610719:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.611071:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98d6 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.611096:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98d6 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.611117:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873869.611120:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788873869.611125:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215ee00, rc 0) 00000100:00100000:2.0:1788873869.611284:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+30:11918:x1875769840200320:12345-192.168.202.20@tcp:101:bash.0 Request processed in 850us (4275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873869.613559:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.613965:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200576 00000100:00100000:1.0:1788873869.613978:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200576 00000100:00100000:1.0:1788873869.614051:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 208 00000100:00100000:1.0:1788873869.614063:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+31:11918:x1875769840200576:12345-192.168.202.20@tcp:36:bash.0 00010000:00010000:1.0:1788873869.614433:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.614444:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 207 00010000:00010000:1.0:1788873869.614456:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.614471:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788873869.614520:0:8993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788873869.614542:0:8993:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e80d074c reply state 0000000011115ee1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.614556:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.614564:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873869.614567:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873869.614571:0:8993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788873869.614605:0:8993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788873869.614725:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+34:11918:x1875769840200576:12345-192.168.202.20@tcp:36:bash.0 Request processed in 662us (1188us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788873869.614732:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 208 00000020:00080000:1.0:1788873869.614736:0:8993:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788873869.617901:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873869.618128:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200704 00000100:00100000:3.0:1788873869.618143:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200704 00000100:00100000:3.0:1788873869.618273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 209 00000100:00100000:3.0:1788873869.618287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+34:11918:x1875769840200704:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:3.0:1788873869.618324:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873869.618355:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c3c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.618431:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98dd expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.618449:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98dd expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.618470:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:3.0:1788873869.618491:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873869.618497:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442600, rc 0) 00000100:00100000:3.0:1788873869.618565:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+35:11918:x1875769840200704:12345-192.168.202.20@tcp:101:bash.0 Request processed in 281us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873869.618573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 209 00000100:00100000:2.0:1788873869.624150:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873869.624684:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200832 00000100:00100000:0.0:1788873869.624699:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200832 00000100:00100000:0.0:1788873869.624819:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:0.0:1788873869.624833:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:11918:x1875769840200832:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873869.624860:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873869.624890:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98e4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788873869.624924:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa00c8c, atime: 0x6aa00c8b, ctime: 0x6aa00c8c, blocks: 0x8 00010000:00010000:0.0:1788873869.624957:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1788873869.624983:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873869.624994:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.625018:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.625036:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9200, rc 0) 00000100:00100000:0.0:1788873869.625174:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:11918:x1875769840200832:12345-192.168.202.20@tcp:101:bash.0 Request processed in 344us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873869.625182:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:0.0:1788873869.628098:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.628362:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840200960 00000100:00100000:1.0:1788873869.628393:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840200960 00002000:00010000:1.0:1788873869.628451:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788873869.628456:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f42d180 with x1875769840200960 ext(0->18446744073709551615) 00002000:00010000:1.0:1788873869.628471:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d347f42d180. 00000100:00100000:1.0:1788873869.628695:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:1.0:1788873869.628709:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840200960:12345-192.168.202.20@tcp:10:bash.0 00002000:00010000:1.0:1788873869.629069:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788873869.629074:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788873868 -> 1788873870 00002000:00010000:1.0:1788873869.629077:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788873867 -> 1788873867 00002000:00010000:1.0:1788873869.629079:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788873868 -> 1788873870 00002000:00010000:1.0:1788873869.629081:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788873869.629192:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840200960:12345-192.168.202.20@tcp:10:bash.0 Request processed in 485us (1107us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788873869.629368:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 5 00002000:00010000:1.0:1788873869.629374:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788873869.629378:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d347f42d180 with x1875769840200960 ext(0->18446744073709551615) 00002000:00010000:1.0:1788873869.629384:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d347f42d180. 00000100:00100000:3.0:1788873869.705985:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873869.706510:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840201088 00000100:00100000:0.0:1788873869.706526:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840201088 00000100:00100000:0.0:1788873869.706634:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 210 00000100:00100000:0.0:1788873869.706648:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+35:12402:x1875769840201088:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:0.0:1788873869.706757:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706782:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706810:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706831:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706838:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706868:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706967:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706977:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.706984:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873869.707047:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707061:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707068:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707075:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707081:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.707086:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707094:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707119:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873869.707129:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873869.707137:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707145:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c3cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707163:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707169:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707175:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707181:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.707183:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707189:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707196:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1e00) 00010000:00010000:0.0:1788873869.707199:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873869.707413:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707421:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8600/0x25c660afb0a9c3d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707450:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707463:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707469:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707475:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.707478:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707490:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707499:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:0.0:1788873869.707501:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873869.707505:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.707509:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c3dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.707623:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+35:12402:x1875769840201088:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 976us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873869.707635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 210 00000100:00100000:3.0:1788873869.766945:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.767743:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840201344 00000100:00100000:1.0:1788873869.767760:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840201344 00000100:00100000:1.0:1788873869.767873:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 211 00000100:00100000:1.0:1788873869.767887:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+35:12405:x1875769840201344:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788873869.767918:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873869.767956:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c3e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98eb expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.768073:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.768126:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.768143:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.768163:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.768172:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.768180:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.769020:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.769055:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.769066:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873869.769082:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788873869.771878:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771900:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771910:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771916:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecae00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873869.771922:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771932:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771952:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873869.771955:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873869.771960:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771967:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c3eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.771990:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772019:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772026:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772030:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873869.772033:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772039:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772046:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410ddb00) 00010000:00010000:2.0:1788873869.772048:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873869.772051:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772056:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb600/0x25c660afb0a9c3f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772163:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecac00/0x25c660afb0a9c3e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98eb expref: 38 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772181:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98eb expref: 37 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.772189:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873869.772192:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788873869.772200:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d348215f800, rc 0) 00000100:00100000:2.0:1788873869.772609:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12405:x1875769840201344:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 4720us (5676us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788873869.772621:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 211 00000100:00100000:3.0:1788873869.779626:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873869.780177:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840201472 00000100:00100000:0.0:1788873869.780192:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840201472 00000100:00100000:0.0:1788873869.780308:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 212 00000100:00100000:0.0:1788873869.780322:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12405:x1875769840201472:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:0.0:1788873869.780434:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.780475:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.780488:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.780540:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.780557:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 37 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873869.780576:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875769859132672:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873869.780856:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873869.783486:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873869.783710:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875769859132672:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873869.783748:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.791798:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840201728 00000100:00100000:2.0:1788873869.791822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840201728 00000100:00100000:2.0:1788873869.791905:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:2.0:1788873869.791918:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+38:6173:x1875769840201728:12345-192.168.202.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788873869.792336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+39:6173:x1875769840201728:12345-192.168.202.20@tcp:35:ldlm_bl.0 Request processed in 419us (8873us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788873869.792344:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:0.0:1788873869.799801:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873869.800177:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840201856 00000100:00100000:1.0:1788873869.800192:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840201856 00010000:00010000:1.0:1788873869.800289:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 39 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873869.800343:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 95 00000100:00100000:1.0:1788873869.800354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+39:2401:x1875769840201856:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873869.800372:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873869.800380:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 39 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.800395:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 39 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.800462:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c39e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98cf expref: 39 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.800483:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:1.0:1788873869.800490:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.800502:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.800512:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873869.800543:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873869.800611:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+38:2401:x1875769840201856:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 258us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873869.800631:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 95 00010000:00010000:2.0:1788873869.801092:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801114:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801168:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801176:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801182:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801186:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873869.801190:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801238:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801251:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873869.801255:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788873869.801260:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.801267:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873869.801336:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12405:x1875769840201472:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 21015us (21729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873869.801345:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 212 00000100:00100000:0.0:1788873869.806170:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873869.806619:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840202112 00000100:00100000:2.0:1788873869.806634:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840202112 00000100:00100000:2.0:1788873869.806748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:2.0:1788873869.806761:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+37:12405:x1875769840202112:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788873869.807052:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+38:12405:x1875769840202112:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 293us (897us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788873869.807059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:3.0:1788873869.918811:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873869.919120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840202368 00000100:00100000:0.0:1788873869.919133:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840202368 00000100:00100000:0.0:1788873869.919239:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 213 00000100:00100000:0.0:1788873869.919251:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+38:12417:x1875769840202368:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:0.0:1788873869.919277:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873869.919301:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c40e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919401:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919417:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919430:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919460:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919469:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919476:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919623:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c423 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919633:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919640:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873869.919653:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788873869.919748:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919758:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919774:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919782:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.919786:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919794:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919809:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873869.919813:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873869.919819:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919825:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c415 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919840:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919846:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919851:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919856:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873869.919858:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919874:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919882:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410e1e00) 00010000:00010000:0.0:1788873869.919884:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873869.919888:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919894:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8e00/0x25c660afb0a9c41c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919940:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c40e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f2 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919955:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f2 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873869.919961:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:0.0:1788873869.919963:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873869.919980:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8000, rc 0) 00000100:00100000:0.0:1788873869.920061:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+40:12417:x1875769840202368:12345-192.168.202.20@tcp:101:cat.0 Request processed in 812us (1268us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788873869.920069:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 213 00000100:00100000:3.0:1788873869.931511:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873869.931985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840202624 00000100:00100000:0.0:1788873869.932119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840202624 00000100:00100000:0.0:1788873869.932186:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:0.0:1788873869.932197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+40:12417:x1875769840202624:12345-192.168.202.20@tcp:35:cat.0 00000100:00100000:0.0:1788873869.933037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+41:12417:x1875769840202624:12345-192.168.202.20@tcp:35:cat.0 Request processed in 838us (1534us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788873869.933047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:1.0:1788873869.987681:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873869.987795:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840202880 00000100:00100000:2.0:1788873869.987809:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840202880 00000100:00100000:2.0:1788873869.987875:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 214 00000100:00100000:2.0:1788873869.987886:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+41:12418:x1875769840202880:12345-192.168.202.20@tcp:36:rm.0 00010000:00010000:2.0:1788873869.987971:0:8993:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788873869.988004:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c3c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98dd expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988053:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c423 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f2 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988067:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215f800/0x25c660afb0a9c3f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98eb expref: 39 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988084:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ee00/0x25c660afb0a9c3b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98d6 expref: 38 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988094:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873869.988099:0:8993:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788873869.988156:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988173:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988184:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988201:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988243:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988251:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988376:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988386:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988393:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873869.988641:0:8993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788873869.988652:0:8993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406934446740ns, next at 407934443970ns, rc = 0 00010000:00010000:2.0:1788873869.988699:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988708:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988715:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988722:0:8993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988729:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988736:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988758:0:8993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788873869.988777:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988796:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988803:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988809:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873869.988816:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988826:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988841:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873869.988842:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873869.988852:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788873869.988863:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988864:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988891:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873869.988895:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c43f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988899:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988936:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988949:0:8993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988958:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873869.988960:0:8993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988963:0:10331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788873869.988971:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988976:0:8993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.988982:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2200/0x25c660afb0a9c446 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.988997:0:8993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215ec00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873869.989014:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873869.989014:0:8993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.989025:0:8993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873869.989032:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873869.989037:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873869.989044:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873869.989050:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873869.989054:0:8993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.989061:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215ec00/0x25c660afb0a9c431 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788873869.989074:0:8993:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb1602a3 reply state 0000000078aea0a8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.989085:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873869.989092:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:2.0:1788873869.989094:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788873869.989097:0:8993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788873869.989255:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+39:12418:x1875769840202880:12345-192.168.202.20@tcp:36:rm.0 Request processed in 1368us (1591us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788873869.989265:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 214 00000100:00100000:3.0:1788873870.046678:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.046904:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840203136 00000100:00100000:2.0:1788873870.046924:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840203136 00000100:00100000:2.0:1788873870.047019:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 215 00000100:00100000:2.0:1788873870.047029:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+39:12424:x1875769840203136:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873870.047058:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873870.047102:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c44d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a98f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047289:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047309:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047322:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047334:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047341:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047348:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788873870.047729:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788873870.047870:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047879:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047886:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047919:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047940:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047947:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047953:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873870.047957:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047965:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047978:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873870.047981:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873870.047986:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.047991:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c454 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788873870.048004:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2f0923b reply state 000000007c3cd61b transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.048015:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.048021:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:2.0:1788873870.048023:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788873870.048025:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788873870.048056:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2c00/0x25c660afb0a9c44d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 42 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.048078:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 41 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.048086:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:2.0:1788873870.048089:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873870.048092:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2e00, rc 0) 00000100:00100000:2.0:1788873870.048197:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+42:12424:x1875769840203136:12345-192.168.202.20@tcp:101:bash.0 Request processed in 1170us (1535us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788873870.048260:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 215 00000100:00100000:3.0:1788873870.054177:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873870.058483:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840203264 00000100:00100000:1.0:1788873870.058501:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840203264 00000100:00100000:1.0:1788873870.058630:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:1.0:1788873870.058643:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2398:x1875769840203264:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:1.0:1788873870.058666:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873870.058694:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9900 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788873870.058721:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788873870.058758:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788873870.058763:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873870.058774:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.058795:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.058809:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecac00, rc 0) 00000100:00100000:1.0:1788873870.059084:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2398:x1875769840203264:12345-192.168.202.20@tcp:101:bash.0 Request processed in 443us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873870.059091:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00080000:2.0:1788873870.059465:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873870.065275:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.065398:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840203392 00000100:00100000:2.0:1788873870.065408:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840203392 00000100:00100000:2.0:1788873870.065464:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:2.0:1788873870.065476:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:12424:x1875769840203392:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873870.065498:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873870.065518:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9907 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.065566:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.065576:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873870.065582:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873870.065587:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.065598:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859132800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873870.065661:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.065678:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873870.065698:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875769859132928:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873870.065707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873870.065849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859132800 00000100:00100000:1.0:1788873870.065858:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859132800 00000100:00100000:1.0:1788873870.065916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788873870.065926:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859132800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873870.065970:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788873870.066042:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788873870.068123:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859132800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2175us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873870.068144:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788873870.068396:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859132800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873870.069025:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875769859132928:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788873870.069063:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.069099:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2c00, rc 0) 00000100:00100000:2.0:1788873870.069198:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+9:12424:x1875769840203392:12345-192.168.202.20@tcp:101:bash.0 Request processed in 3724us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873870.069235:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:3.0:1788873870.072438:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.072580:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840203520 00000100:00100000:2.0:1788873870.072594:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840203520 00010000:00010000:2.0:1788873870.072657:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873870.072779:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 96 00000100:00100000:2.0:1788873870.072809:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840203520:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873870.072857:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873870.072888:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.072904:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.072935:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8ff4e3d/0x25c660afb0a9c470 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9900 expref: 9 pid: 8425 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.072959:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873870.072964:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788873870.072974:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.072985:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.073034:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873870.073053:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1875769859133056:192.168.202.20@tcp:105: 00000100:00100000:2.0:1788873870.073174:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788873870.077613:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1875769859133056:192.168.202.20@tcp:105: 00010000:00010000:3.0:1788873870.077660:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873870.077915:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840203520:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 5106us (5489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.077929:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 96 00000100:00100000:0.0:1788873870.078177:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.078848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840203776 00000100:00100000:2.0:1788873870.078863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840203776 00000100:00100000:2.0:1788873870.079543:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:2.0:1788873870.079582:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+42:12424:x1875769840203776:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:2.0:1788873870.080026:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12424:x1875769840203776:12345-192.168.202.20@tcp:35:bash.0 Request processed in 446us (1848us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788873870.080035:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:1.0:1788873870.275202:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.275893:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840203904 00000100:00100000:3.0:1788873870.275905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840203904 00000100:00100000:3.0:1788873870.275982:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 216 00000100:00100000:3.0:1788873870.275991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+43:12440:x1875769840203904:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873870.276020:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873870.276050:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c47e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a990e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.276154:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.276171:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.276187:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873870.276268:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788873870.276271:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873870.276315:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.276354:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a990e expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.276374:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a990e expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.276382:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873870.276385:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873870.276390:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873870.276470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+44:12440:x1875769840203904:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 479us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.276476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 216 00000100:00100000:1.0:1788873870.280359:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.280497:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840204160 00000100:00100000:2.0:1788873870.280522:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840204160 00000100:00100000:2.0:1788873870.280612:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 217 00000100:00100000:2.0:1788873870.280626:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+44:12440:x1875769840204160:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873870.280659:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873870.280690:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c48c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9915 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.280854:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2800/0x25c660afb0a9c493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.280873:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2800/0x25c660afb0a9c493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.280889:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2800/0x25c660afb0a9c493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873870.280903:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788873870.281053:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3800/0x25c660afb0a9c48c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9915 expref: 47 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.281080:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2800/0x25c660afb0a9c493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9915 expref: 46 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.281135:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:2.0:1788873870.281139:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873870.281144:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2800, rc 0) 00000100:00100000:2.0:1788873870.281284:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+46:12440:x1875769840204160:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 660us (950us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788873870.281293:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 217 00000100:00100000:0.0:1788873870.284132:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.284265:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840204416 00000100:00100000:2.0:1788873870.284279:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840204416 00000100:00100000:2.0:1788873870.284364:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 218 00000100:00100000:2.0:1788873870.284377:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+46:12440:x1875769840204416:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873870.284415:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873870.284444:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3200/0x25c660afb0a9c4a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a991c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.284664:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3a00/0x25c660afb0a9c4a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.284685:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3a00/0x25c660afb0a9c4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.284700:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3a00/0x25c660afb0a9c4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873870.284719:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788873870.284874:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3200/0x25c660afb0a9c4a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a991c expref: 49 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.284927:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3a00/0x25c660afb0a9c4a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a991c expref: 48 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.284939:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:2.0:1788873870.284942:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788873870.284947:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b3a00, rc 0) 00000100:00100000:2.0:1788873870.285039:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+48:12440:x1875769840204416:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 664us (939us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788873870.285048:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 218 00000100:00100000:1.0:1788873870.288076:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.294503:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840204544 00000100:00100000:0.0:1788873870.294665:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840204544 00000100:00100000:0.0:1788873870.295957:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:0.0:1788873870.295982:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+48:2399:x1875769840204544:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873870.296011:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873870.296056:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2800/0x25c660afb0a9c493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9915 expref: 48 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.296087:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:0.0:1788873870.296095:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873870.296227:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+47:2399:x1875769840204544:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 254us (8166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873870.296236:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:1.0:1788873870.296399:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873870.296561:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840204672 00000100:00100000:1.0:1788873870.296570:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840204672 00000100:00100000:1.0:1788873870.296673:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:1.0:1788873870.296682:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840204672:12345-192.168.202.20@tcp:1:lfs.0 00010000:00010000:1.0:1788873870.296736:0:8789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.296761:0:8789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.296771:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788873870.296776:0:8789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788873870.296782:0:8789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.296826:0:8789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.296843:0:8789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 8 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873870.296861:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8789:1875769859133184:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788873870.296951:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873870.306670:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.306806:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840204800 00000100:00100000:3.0:1788873870.306820:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840204800 00000100:00100000:0.0:1788873870.306889:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8789:1875769859133184:192.168.202.20@tcp:104: 00002000:00100000:3.0:1788873870.306895:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d3343805c00 x1875769840204800/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:286/0 lens 504/0 e 0 to 0 dl 1788873881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788873870.306905:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3343805c00 with x1875769840204800 ext(0->8) 00010000:00010000:3.0:1788873870.306916:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 9 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.306923:0:8789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.306935:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 9 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788873870.306943:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d3343805c00 00000100:00100000:3.0:1788873870.306977:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:3.0:1788873870.306995:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840204800:12345-192.168.202.20@tcp:4:lfs.0 00000100:00100000:3.0:1788873870.310153:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2401:x1875769840204800:12345-192.168.202.20@tcp:4:lfs.0 Request processed in 3137us (3478us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788873870.310173:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00002000:00100000:3.0:1788873870.310190:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d3343805c00 x1875769840204800/t4294967309(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:286/0 lens 504/448 e 0 to 0 dl 1788873881 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788873870.310222:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3343805c00 with x1875769840204800 ext(0->8) 00010000:00010000:3.0:1788873870.310236:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 11 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.310262:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 11 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788873870.310272:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d3343805c00 00000100:00100000:2.0:1788873870.314112:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873870.314292:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840204928 00000100:00100000:1.0:1788873870.314319:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840204928 00010000:00010000:1.0:1788873870.314391:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 11 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873870.314486:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 97 00000100:00100000:1.0:1788873870.314498:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2400:x1875769840204928:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788873870.314520:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788873870.314547:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788873870.314550:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788873870 00002000:00010000:1.0:1788873870.314554:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788873871 00002000:00010000:1.0:1788873870.314556:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788873870 00002000:00010000:1.0:1788873870.314558:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788873870.314566:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 11 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.314585:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 11 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.314628:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9c477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9907 expref: 11 pid: 8427 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.314651:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788873870.314656:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788873870.314663:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.314675:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.314728:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873870.315368:0:8789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315384:0:8789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315412:0:8789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315423:0:8789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315432:0:8789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315441:0:8789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873870.315446:0:8789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315457:0:8789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315472:0:8789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.315495:0:8789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9c4b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.315751:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2400:x1875769840204672:12345-192.168.202.20@tcp:1:lfs.0 Request processed in 19066us (19348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873870.315762:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:1.0:1788873870.316032:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2400:x1875769840204928:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 325us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873870.316043:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 97 00000100:00100000:2.0:1788873870.318263:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.318489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840205184 00000100:00100000:0.0:1788873870.318505:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840205184 00000100:00100000:0.0:1788873870.318591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:0.0:1788873870.318604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480dc2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+47:12440:x1875769840205184:12345-192.168.202.20@tcp:35:lfs.0 00000004:00010000:0.0:1788873870.318701:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3a00/0x25c660afb0a9c4a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a991c expref: 47 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873870.319021:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788873870.319058:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788873870.319799:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788873870.319858:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.319881:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 51 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.319893:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.319944:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 51 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.319983:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 51 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.320002:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875769859133312:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873870.320178:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873870.335502:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.336493:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840205312 00000100:00100000:3.0:1788873870.336510:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840205312 00010000:00010000:3.0:1788873870.336588:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 52 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873870.336655:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 98 00000100:00100000:3.0:1788873870.336670:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+52:2400:x1875769840205312:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873870.336694:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873870.336704:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 52 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.336722:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 52 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.336780:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:3.0:1788873870.336788:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.336804:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.336813:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.336845:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873870.336937:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+52:2400:x1875769840205312:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 270us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.336948:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 98 00010000:00010000:0.0:1788873870.337668:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2e00/0x25c660afb0a9c462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98f9 expref: 51 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.337693:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875769859133312:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873870.337727:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.337739:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.337747:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873870.337923:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788873870.338083:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788873870.338271:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875769859133440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788873870.339582:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873870.341344:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873870.345323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859133440 00000100:00100000:2.0:1788873870.345472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859133440 00000100:00100000:3.0:1788873870.345695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788873870.345710:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6514:x1875769859133440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788873870.345932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6514:x1875769859133440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 225us (6358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.345940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788873870.346071:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875769859133440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788873870.346397:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788873870.346516:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875769859133568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788873870.346609:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873870.346649:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873870.346824:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859133568 00000100:00100000:3.0:1788873870.346831:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859133568 00000100:00100000:3.0:1788873870.346871:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788873870.346880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6514:x1875769859133568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788873870.347017:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6514:x1875769859133568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (408us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788873870.347024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1788873870.347704:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873870.348956:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875769859133568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788873870.349093:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788873870.349186:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.349201:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.349232:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.349239:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873870.349245:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.349255:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.349278:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:0.0:1788873870.349282:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788873870.349289:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.349296:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788873870.349446:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788873870.349543:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788873870.349557:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407295351665ns, next at 408295348782ns, rc = 0 00000001:00080000:0.0:1788873870.349582:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788873870.353280:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc6700) 00010000:00010000:0.0:1788873870.353301:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788873870.353321:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3a00/0x25c660afb0a9c4a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a991c expref: 55 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.353560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480dc2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+54:12440:x1875769840205184:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 34956us (35356us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788873870.353572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 56 00000020:00080000:0.0:1788873870.353581:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788873870.357176:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.357303:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840205440 00000100:00100000:3.0:1788873870.357322:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840205440 00000100:00100000:3.0:1788873870.357422:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 219 00000100:00100000:3.0:1788873870.357439:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+54:12440:x1875769840205440:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873870.357486:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873870.357532:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c4c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9923 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.357665:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c4c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9923 expref: 55 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.357687:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c4c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9923 expref: 55 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.357717:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.357721:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873870.357727:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443a00, rc 0) 00000100:00100000:3.0:1788873870.357832:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+55:12440:x1875769840205440:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 399us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.357840:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 219 00000100:00100000:2.0:1788873870.360948:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.361065:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840205696 00000100:00100000:3.0:1788873870.361079:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840205696 00000100:00100000:3.0:1788873870.361161:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:3.0:1788873870.361175:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+55:12440:x1875769840205696:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873870.361554:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+56:12440:x1875769840205696:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 381us (619us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788873870.361563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00010000:00010000:0.0:1788873870.446501:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873870.466197:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.466399:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840205824 00000100:00100000:0.0:1788873870.466416:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840205824 00000100:00100000:0.0:1788873870.466499:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 220 00000100:00100000:0.0:1788873870.466513:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+56:12450:x1875769840205824:12345-192.168.202.20@tcp:34:lfs.0 00010000:00010000:0.0:1788873870.466618:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466642:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466658:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466672:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466680:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466687:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466804:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466813:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466820:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873870.466885:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466900:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466906:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466926:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466934:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873870.466939:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466949:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466964:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873870.466969:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873870.466976:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.466989:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c4cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467007:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467013:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467019:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467024:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873870.467028:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467034:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467042:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:0.0:1788873870.467045:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873870.467049:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467055:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c4d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467065:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467071:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467083:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467088:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873870.467091:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467108:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467118:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873870.467121:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873870.467124:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.467130:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c4d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.467355:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+56:12450:x1875769840205824:12345-192.168.202.20@tcp:34:lfs.0 Request processed in 842us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873870.467365:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 220 00000100:00100000:2.0:1788873870.498910:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.499173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840206080 00000100:00100000:3.0:1788873870.499186:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840206080 00000100:00100000:3.0:1788873870.499306:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 221 00000100:00100000:3.0:1788873870.499318:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+56:12453:x1875769840206080:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873870.499348:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873870.499377:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c4e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a992a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.499479:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.499496:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.499510:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.499526:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.499535:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.499543:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500122:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c4f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500260:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500295:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873870.500310:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788873870.500395:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500402:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500409:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500415:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873870.500420:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500428:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500440:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873870.500818:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873870.500825:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500833:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c4e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500852:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.500859:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504249:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504259:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873870.504264:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504275:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504294:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:3.0:1788873870.504298:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873870.504303:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504311:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c4ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504383:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c4e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a992a expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504400:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a992a expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.504408:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.504410:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873870.504413:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873870.504503:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+58:12453:x1875769840206080:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 5186us (5608us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788873870.504531:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 221 00000100:00100000:1.0:1788873870.515426:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.516509:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840206208 00000100:00100000:3.0:1788873870.516526:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840206208 00000100:00100000:3.0:1788873870.516607:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 222 00000100:00100000:3.0:1788873870.516618:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+58:12453:x1875769840206208:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:3.0:1788873870.516692:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516710:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516722:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516757:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516764:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516771:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516777:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873870.516782:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516789:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516800:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.516816:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873870.516822:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.516829:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873870.516918:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+58:12453:x1875769840206208:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 301us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.516926:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 222 00000100:00100000:2.0:1788873870.521920:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.522027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840206464 00000100:00100000:3.0:1788873870.522041:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840206464 00000100:00100000:3.0:1788873870.522136:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:3.0:1788873870.522150:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+58:12453:x1875769840206464:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788873870.522951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12453:x1875769840206464:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 797us (1043us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788873870.522962:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:2.0:1788873870.662948:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.666059:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840206720 00000100:00100000:0.0:1788873870.666082:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840206720 00000100:00100000:0.0:1788873870.666198:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 223 00000100:00100000:0.0:1788873870.666255:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12463:x1875769840206720:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:0.0:1788873870.666292:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873870.666296:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788873870.666335:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a990e expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.666388:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873870.666396:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873870.666416:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c50a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9931 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.666554:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.666570:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.666583:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873870.666597:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788873870.666755:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c50a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9931 expref: 61 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.666773:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9931 expref: 60 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.666781:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873870.666784:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873870.666787:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9000, rc 0) 00000100:00100000:0.0:1788873870.666886:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:12463:x1875769840206720:12345-192.168.202.20@tcp:101:bash.0 Request processed in 633us (3953us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788873870.666894:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 223 00000100:00100000:1.0:1788873870.670491:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.670828:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840206848 00000100:00100000:3.0:1788873870.670844:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840206848 00000100:00100000:3.0:1788873870.670929:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:3.0:1788873870.670941:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+60:2401:x1875769840206848:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873870.670961:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873870.670993:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9931 expref: 60 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.671021:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.671028:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873870.671110:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+59:2401:x1875769840206848:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 162us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.671139:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:1.0:1788873870.677605:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.677705:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840206976 00000100:00100000:3.0:1788873870.677719:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840206976 00000100:00100000:3.0:1788873870.677814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 224 00000100:00100000:3.0:1788873870.677827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+59:12463:x1875769840206976:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:3.0:1788873870.677865:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873870.677894:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c51f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9938 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.677939:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.677957:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.677971:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.678126:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c51f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.678150:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.678162:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.678166:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788873870.678170:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442600, rc 0) 00000100:00100000:3.0:1788873870.678303:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+60:12463:x1875769840206976:12345-192.168.202.20@tcp:101:bash.0 Request processed in 478us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.678320:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 224 00000100:00100000:2.0:1788873870.681854:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.682086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840207232 00000100:00100000:0.0:1788873870.682114:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840207232 00000100:00100000:0.0:1788873870.682242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 225 00000100:00100000:0.0:1788873870.682257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+60:12463:x1875769840207232:12345-192.168.202.20@tcp:36:bash.0 00010000:00010000:0.0:1788873870.682340:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873870.682381:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c4f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a992a expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.682405:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873870.682412:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788873870.682817:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.682835:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.682847:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788873870.682903:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788873870.682930:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e02f7e9 reply state 0000000035c07605 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.682942:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.682950:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:1.0:1788873870.682953:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788873870.682957:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873870.683089:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+62:12463:x1875769840207232:12345-192.168.202.20@tcp:36:bash.0 Request processed in 834us (1250us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788873870.683133:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 225 00000020:00080000:1.0:1788873870.683141:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788873870.688965:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.689496:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840207360 00000100:00100000:2.0:1788873870.689513:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840207360 00000100:00100000:2.0:1788873870.689599:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 226 00000100:00100000:2.0:1788873870.689611:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+62:12463:x1875769840207360:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:2.0:1788873870.689657:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873870.689685:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2400/0x25c660afb0a9c534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a993f expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.689830:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.689848:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.689862:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873870.689895:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788873870.689900:0:8993:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873870.689921:0:8993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.689960:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2400/0x25c660afb0a9c534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 64 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.689980:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 63 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.689990:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873870.689994:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788873870.689998:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2a00, rc 0) 00000100:00100000:2.0:1788873870.690065:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+63:12463:x1875769840207360:12345-192.168.202.20@tcp:101:bash.0 Request processed in 457us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873870.690071:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 226 00000100:00100000:2.0:1788873870.693895:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.694157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840207616 00000100:00100000:0.0:1788873870.694172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840207616 00000100:00100000:0.0:1788873870.694269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:0.0:1788873870.694285:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+63:12463:x1875769840207616:12345-192.168.202.20@tcp:35:bash.0 00000100:00100000:0.0:1788873870.694633:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+64:12463:x1875769840207616:12345-192.168.202.20@tcp:35:bash.0 Request processed in 345us (746us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788873870.694642:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:1.0:1788873870.763525:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873870.763801:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840207744 00000100:00100000:2.0:1788873870.763819:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840207744 00000100:00100000:2.0:1788873870.763921:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 227 00000100:00100000:2.0:1788873870.763933:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3447054c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+64:12469:x1875769840207744:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873870.763977:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873870.764008:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2400/0x25c660afb0a9c542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9946 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.764485:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2000/0x25c660afb0a9c549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.764505:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2000/0x25c660afb0a9c549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.764520:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2000/0x25c660afb0a9c549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873870.764579:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788873870.764583:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788873870.764619:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2000/0x25c660afb0a9c549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.764784:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2400/0x25c660afb0a9c542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9946 expref: 66 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.765704:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2000/0x25c660afb0a9c549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9946 expref: 65 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873870.765721:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:2.0:1788873870.765748:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788873870.765754:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2000, rc 0) 00000100:00100000:2.0:1788873870.765923:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3447054c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12469:x1875769840207744:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 1989us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873870.765934:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 227 00000100:00100000:1.0:1788873870.776485:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.778468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840207872 00000100:00100000:3.0:1788873870.778490:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840207872 00000100:00100000:3.0:1788873870.778766:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 228 00000100:00100000:3.0:1788873870.778861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12469:x1875769840207872:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873870.778892:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873870.779713:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c550 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a994d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779824:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779845:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779861:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779875:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779883:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779889:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.779987:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780023:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780032:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873870.780088:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788873870.780094:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873870.780132:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780147:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780157:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780165:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780171:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780178:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873870.780183:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780192:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780511:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873870.780516:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873870.780533:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780542:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c557 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780559:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780565:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780571:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780576:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873870.780579:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780639:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780650:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:3.0:1788873870.780653:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873870.780657:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780663:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c55e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780707:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c550 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a994d expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780734:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a994d expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.780742:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.780745:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788873870.780748:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873870.782226:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12469:x1875769840207872:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 3415us (5724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.782246:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 228 00000100:00100000:1.0:1788873870.790721:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873870.790785:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.790817:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840208128 00000100:00100000:0.0:1788873870.790838:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840208128 00000100:00100000:0.0:1788873870.790952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 229 00000100:00100000:0.0:1788873870.790968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12469:x1875769840208128:12345-192.168.202.20@tcp:101:lfs.0 00000100:00100000:3.0:1788873870.791003:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840208256 00010000:00010000:0.0:1788873870.791007:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788873870.791010:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840208256 00010000:00010000:0.0:1788873870.791058:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c56c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9954 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873870.791071:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:3.0:1788873870.791082:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+68:2401:x1875769840208256:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873870.791108:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873870.791144:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a994d expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.791184:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.791192:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873870.791329:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873870.791352:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+67:2401:x1875769840208256:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 269us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.791363:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00010000:00010000:0.0:1788873870.791384:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 66 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.791397:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.791450:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 66 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.791469:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 66 pid: 8993 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.791489:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859133696:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873870.791585:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342753e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873870.795418:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859133696:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873870.795460:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873870.799274:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.800973:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840208384 00000100:00100000:0.0:1788873870.800996:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840208384 00010000:00010000:0.0:1788873870.801067:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 67 pid: 8993 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873870.801134:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 99 00000100:00100000:0.0:1788873870.801146:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+67:2400:x1875769840208384:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873870.801167:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873870.801196:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 67 pid: 8993 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.801260:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 67 pid: 8993 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.801293:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c53b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a993f expref: 67 pid: 8993 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.801316:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873870.801323:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.801336:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.801346:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.801381:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873870.801470:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+66:2400:x1875769840208384:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 325us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873870.801479:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 99 00010000:00010000:1.0:1788873870.802926:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.802945:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873870.802972:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788873870.803169:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c56c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.803192:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873870.803262:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:1.0:1788873870.803266:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788873870.803270:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9c00, rc 0) 00000100:00100000:1.0:1788873870.803404:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12469:x1875769840208128:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 12439us (12698us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788873870.803414:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 229 00000100:00100000:1.0:1788873870.819690:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.819797:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840208640 00000100:00100000:3.0:1788873870.819811:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840208640 00000100:00100000:3.0:1788873870.819918:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:3.0:1788873870.819942:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12469:x1875769840208640:12345-192.168.202.20@tcp:103:lfs.0 00010000:00010000:3.0:1788873870.819964:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873870.819998:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c4c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9923 expref: 66 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.820026:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.820033:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873870.820122:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12469:x1875769840208640:12345-192.168.202.20@tcp:103:lfs.0 Request processed in 183us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.820130:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:3.0:1788873870.822297:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873870.822406:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840208768 00000100:00100000:0.0:1788873870.822419:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840208768 00000100:00100000:0.0:1788873870.822493:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 230 00000100:00100000:0.0:1788873870.822504:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12469:x1875769840208768:12345-192.168.202.20@tcp:58:lfs.0 00010000:00010000:0.0:1788873870.822674:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.822718:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873870.822733:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873870.822973:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788873870.823251:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12469:x1875769840208768:12345-192.168.202.20@tcp:58:lfs.0 Request processed in 748us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873870.823261:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 230 00000100:00100000:2.0:1788873870.829354:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873870.829484:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840208896 00000100:00100000:3.0:1788873870.829498:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840208896 00000100:00100000:3.0:1788873870.829572:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 231 00000100:00100000:3.0:1788873870.829584:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+65:12469:x1875769840208896:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788873870.829614:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873870.829825:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a995b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.830030:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.830047:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.830073:0:6511:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.830126:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.830145:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873870.830149:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873870.830153:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873870.830161:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443a00, rc 0) 00000100:00100000:3.0:1788873870.832042:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12469:x1875769840208896:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 2449us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873870.832053:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 231 00000040:00080000:1.0:1788873871.152332:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873871.152349:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873871.152390:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788873871.152414:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788873871.152748:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859133824:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788873871.152923:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873871.168083:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859133824:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788873871.168815:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873871.172983:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840209024 00000100:00100000:1.0:1788873871.173006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840209024 00000100:00100000:1.0:1788873871.173148:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 232 00000100:00100000:1.0:1788873871.173161:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12470:x1875769840209024:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788873871.173257:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788873871.173443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12470:x1875769840209024:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 283us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873871.173451:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 232 00000100:00080000:2.0:1788873871.173644:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873871.185167:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.185387:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840209152 00000100:00100000:0.0:1788873871.185402:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840209152 00000100:00100000:0.0:1788873871.185479:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 233 00000100:00100000:0.0:1788873871.185492:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12470:x1875769840209152:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.185595:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185618:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185635:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185654:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185661:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185667:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185714:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185724:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185730:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873871.185789:0:8450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788873871.185806:0:8450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873871.185823:0:8450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185835:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185842:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185849:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185856:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873871.185861:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185870:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185884:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:0.0:1788873871.185893:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873871.185900:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185907:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c58f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185923:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185929:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185934:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185940:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873871.185942:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185948:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185956:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9d33410e1e00) 00010000:00010000:0.0:1788873871.185958:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873871.185961:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185967:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c596 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185983:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.185996:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.186002:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.186007:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873871.186010:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.186016:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.186023:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873871.186027:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873871.186029:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.186035:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8c00/0x25c660afb0a9c59d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.186524:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12470:x1875769840209152:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 Request processed in 1028us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.186536:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 233 00000100:00100000:0.0:1788873871.190051:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.190152:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840209408 00000100:00100000:3.0:1788873871.190167:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840209408 00000100:00100000:3.0:1788873871.191495:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 234 00000100:00100000:3.0:1788873871.191518:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+66:12470:x1875769840209408:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873871.191550:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873871.191831:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9962 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.191984:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.192003:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.192019:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873871.192052:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788873871.192984:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193001:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193009:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193016:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873871.193023:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193033:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193052:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873871.193056:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788873871.193063:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193071:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193148:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9962 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193161:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:3.0:1788873871.193164:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788873871.193181:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9962 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.193195:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873871.193357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+67:12470:x1875769840209408:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 1848us (3320us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788873871.193368:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 234 00000100:00100000:1.0:1788873871.199059:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.207728:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840209536 00000100:00100000:3.0:1788873871.207755:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840209536 00000100:00100000:2.0:1788873871.210172:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 235 00000100:00100000:2.0:1788873871.210190:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+67:12470:x1875769840209536:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788873871.210430:0:8993:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788873871.210692:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+67:12470:x1875769840209536:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 503us (11646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.210701:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 235 00000100:00100000:2.0:1788873871.215564:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.216352:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840209792 00000100:00100000:0.0:1788873871.216367:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840209792 00000100:00100000:0.0:1788873871.216456:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 236 00000100:00100000:0.0:1788873871.216470:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+67:12470:x1875769840209792:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.216514:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873871.216518:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788873871.216552:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2000/0x25c660afb0a9c549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9946 expref: 67 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.216577:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873871.216685:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873871.216706:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c5b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9969 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788873871.217467:0:8450:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788873871.223744:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c5c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.223909:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.223930:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.225972:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c5b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9969 expref: 69 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.226027:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9969 expref: 68 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.226041:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1e00) 00010000:00010000:0.0:1788873871.226044:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873871.226082:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8200, rc 0) 00000100:00100000:1.0:1788873871.226367:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+68:12470:x1875769840209792:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 9896us (10816us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788873871.226380:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 236 00000100:00100000:0.0:1788873871.240482:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.240576:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840210048 00000100:00100000:3.0:1788873871.240605:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840210048 00000100:00100000:3.0:1788873871.240679:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 237 00000100:00100000:3.0:1788873871.240691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+68:12470:x1875769840210048:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788873871.240783:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873871.241306:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8200/0x25c660afb0a9c5c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9969 expref: 68 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241333:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1e00) 00010000:00010000:3.0:1788873871.241348:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873871.241382:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241399:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241410:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241425:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241452:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241460:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241520:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241528:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241535:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241541:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873871.241546:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241555:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241563:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:3.0:1788873871.241566:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873871.241571:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241576:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9c5ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241683:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241697:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241704:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241709:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873871.241713:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241719:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241727:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x155fb6e0 (ffff9d3476dc2200) 00010000:00010000:3.0:1788873871.241730:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788873871.241733:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.241738:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x155fb6e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.242035:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+67:12470:x1875769840210048:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 1342us (1563us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788873871.242045:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 237 00000100:00100000:2.0:1788873871.262563:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.262778:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840210176 00000100:00100000:0.0:1788873871.262792:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840210176 00000100:00100000:0.0:1788873871.262872:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 238 00000100:00100000:0.0:1788873871.262884:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+67:12470:x1875769840210176:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.262910:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873871.262945:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c5dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9970 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.262993:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.263013:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.263028:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.263193:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c5dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 69 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.263257:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 68 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.263267:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:0.0:1788873871.263270:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788873871.263275:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8a00, rc 0) 00000100:00100000:0.0:1788873871.263365:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+68:12470:x1875769840210176:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 483us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.263381:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 238 00000100:00100000:2.0:1788873871.266510:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873871.266871:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840210432 00000100:00100000:1.0:1788873871.266886:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840210432 00000100:00100000:1.0:1788873871.266963:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 239 00000100:00100000:1.0:1788873871.266975:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+68:12470:x1875769840210432:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788873871.267105:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.267154:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.267170:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873871.267446:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788873871.267459:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408213253332ns, next at 409213249877ns, rc = 0 00000004:00010000:1.0:1788873871.267526:0:8450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006cb3733 reply state 000000006026b1ff transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.267542:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.267551:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:1.0:1788873871.267555:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788873871.267560:0:8450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788873871.268036:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+70:12470:x1875769840210432:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 1057us (1537us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788873871.268046:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 239 00000100:00100000:2.0:1788873871.270494:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.270597:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840210560 00000100:00100000:3.0:1788873871.270609:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840210560 00000100:00100000:3.0:1788873871.270677:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 240 00000100:00100000:3.0:1788873871.270689:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+70:12470:x1875769840210560:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873871.270718:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873871.270762:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9977 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.271028:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 71 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.271046:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 71 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.271068:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:3.0:1788873871.271071:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788873871.271076:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442e00, rc 0) 00000100:00100000:3.0:1788873871.271155:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+71:12470:x1875769840210560:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 468us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.271163:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 240 00000100:00100000:2.0:1788873871.282963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.283112:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840210688 00000100:00100000:0.0:1788873871.283129:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840210688 00000100:00100000:0.0:1788873871.283293:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 70 00000100:00100000:0.0:1788873871.283308:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2400:x1875769840210688:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788873871.283765:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873871.283897:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2400:x1875769840210688:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 589us (951us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788873871.283909:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 70 00000100:00100000:2.0:1788873871.298407:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.298499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840210944 00000100:00100000:3.0:1788873871.298513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840210944 00000100:00100000:3.0:1788873871.298605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:3.0:1788873871.298618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+71:12470:x1875769840210944:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788873871.298927:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+72:12470:x1875769840210944:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 311us (535us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788873871.298936:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:0.0:1788873871.303337:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873871.303454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840211200 00000100:00100000:1.0:1788873871.303472:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840211200 00000100:00100000:1.0:1788873871.303566:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 241 00000100:00100000:1.0:1788873871.303580:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+72:12470:x1875769840211200:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788873871.303764:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+72:12470:x1875769840211200:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 186us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873871.303772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 241 00000100:00100000:2.0:1788873871.314067:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.314305:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840211328 00000100:00100000:0.0:1788873871.314320:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840211328 00000100:00100000:0.0:1788873871.314408:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 242 00000100:00100000:0.0:1788873871.314421:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+72:12470:x1875769840211328:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.314450:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873871.314482:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c5f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a997e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.315803:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c5ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.315835:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.315855:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873871.315932:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788873871.315987:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.316033:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9600/0x25c660afb0a9c5f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a997e expref: 74 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.316058:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c5ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a997e expref: 73 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.316069:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:0.0:1788873871.316072:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788873871.316078:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9000, rc 0) 00000100:00100000:0.0:1788873871.316197:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+73:12470:x1875769840211328:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 1778us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.316773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 242 00000100:00100000:1.0:1788873871.322502:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.325897:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840211456 00000100:00100000:3.0:1788873871.325917:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840211456 00000100:00100000:3.0:1788873871.326004:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 71 00000100:00100000:3.0:1788873871.326017:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+10:2401:x1875769840211456:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788873871.326041:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873871.326089:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9985 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788873871.326136:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa00c90, blocks: 0x0 00010000:00010000:3.0:1788873871.326165:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788873871.326170:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873871.326183:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.326227:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.326246:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443e00, rc 0) 00000100:00100000:3.0:1788873871.326336:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2401:x1875769840211456:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 321us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.326345:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 71 00000100:00100000:2.0:1788873871.331609:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.331717:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840211712 00000100:00100000:3.0:1788873871.331732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840211712 00000100:00100000:3.0:1788873871.331815:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 243 00000100:00100000:3.0:1788873871.331830:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+73:12470:x1875769840211712:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788873871.331998:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+73:12470:x1875769840211712:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.332007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 243 00000100:00100000:1.0:1788873871.338340:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.338489:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840211840 00000100:00100000:0.0:1788873871.338503:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840211840 00000100:00100000:0.0:1788873871.338579:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 72 00000100:00100000:0.0:1788873871.338594:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+11:12470:x1875769840211840:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.338619:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873871.338643:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a998c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.338685:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.338696:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873871.338702:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873871.338727:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.338772:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.338789:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.338807:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8424:1875769859133952:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873871.338941:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873871.346941:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8424:1875769859133952:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873871.346999:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.347033:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9600, rc 0) 00000100:00100000:0.0:1788873871.347185:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+12:12470:x1875769840211840:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 8593us (8860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.347196:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 72 00000100:00100000:1.0:1788873871.359454:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.360169:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840211968 00000100:00100000:0.0:1788873871.360186:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840211968 00010000:00010000:0.0:1788873871.360288:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.360393:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 100 00000100:00100000:0.0:1788873871.360410:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+12:2401:x1875769840211968:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873871.360459:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873871.360497:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.360516:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.360550:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9c606 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9985 expref: 12 pid: 8425 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.360573:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873871.360577:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873871.360599:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 11 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.360612:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 11 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.360667:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 11 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.360685:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875769859134080:192.168.202.20@tcp:105: 00000100:00100000:0.0:1788873871.360807:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873871.367320:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875769859134080:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788873871.367357:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873871.367453:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2401:x1875769840211968:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 7046us (8018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.367468:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 100 00000100:00100000:2.0:1788873871.368444:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873871.368533:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840212096 00000100:00100000:1.0:1788873871.368543:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840212096 00002000:00100000:1.0:1788873871.368618:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9d33441b8700 x1875769840212096/t0(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:287/0 lens 504/0 e 0 to 0 dl 1788873882 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873871.368631:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d33441b8700 with x1875769840212096 ext(0->12) 00002000:00010000:1.0:1788873871.368638:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d33441b8700 00000100:00100000:1.0:1788873871.368673:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:1.0:1788873871.368685:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+11:2401:x1875769840212096:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788873871.372751:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2401:x1875769840212096:12345-192.168.202.20@tcp:4:lhsmtool_posix.0 Request processed in 4055us (4302us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788873871.372767:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 6 00002000:00100000:1.0:1788873871.372782:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9d33441b8700 x1875769840212096/t4294967321(0) o4->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:287/0 lens 504/448 e 0 to 0 dl 1788873882 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788873871.372793:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d33441b8700 with x1875769840212096 ext(0->12) 00002000:00010000:1.0:1788873871.372800:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d33441b8700 00000100:00100000:1.0:1788873871.380158:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.382336:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840212224 00000100:00100000:3.0:1788873871.382353:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840212224 00000100:00100000:3.0:1788873871.382440:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 244 00000100:00100000:3.0:1788873871.382464:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+73:12470:x1875769840212224:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788873871.386995:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1788873871.387014:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788873871.387061:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788873871.387084:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3342753a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788873871.387089:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d3475fa9700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3342753000 00000020:00080000:0.0:1788873871.387100:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d3475fa9200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d33438b5c00 00000004:00080000:0.0:1788873871.387124:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788873871.387148:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d347a6d1180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788873871.387151:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d3475fa9300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d347a6d1b40 00000020:00080000:0.0:1788873871.387154:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d3475fa9100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3445f46a00 00000020:00080000:3.0:1788873871.387765:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788873871.387827:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788873871.387838:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873871.387860:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859134208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788873871.387944:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873871.387994:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859134208 00000100:00100000:3.0:1788873871.388002:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859134208 00000100:00100000:3.0:1788873871.388181:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788873871.388192:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3634:x1875769859134208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788873871.388258:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788873871.388294:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa00c8e, atime: 0x6aa00c8f, ctime: 0x6aa00c8e, blocks: 0x8 00010000:00010000:3.0:1788873871.388303:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388321:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788873871.388325:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873871.388332:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388350:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388360:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388368:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388401:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788873871.388533:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3634:x1875769859134208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 342us (587us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788873871.388540:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1788873871.388780:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343afe300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788873871.388786:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859134208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788873871.388896:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12470:x1875769840212224:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 Request processed in 6434us (10451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.388905:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 244 00010000:00010000:3.0:1788873871.388943:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873871.388949:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388958:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873871.388963:0:10332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388973:0:10332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388991:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.388999:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001769a3f3/0x25c660afb0a9c614 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.389047:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873871.389050:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873871.389051:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873871.389532:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859134464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788873871.389680:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873871.389735:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859134464 00000100:00100000:1.0:1788873871.389741:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859134464 00000100:00100000:1.0:1788873871.389937:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788873871.389948:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875769859134464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788873871.390087:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788873871.390107:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788873872 00002000:00010000:1.0:1788873871.390110:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788873871.390112:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788873872 -> 1788873872 00002000:00010000:1.0:1788873871.390114:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788873871.390156:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875769859134464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (476us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788873871.390163:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788873871.390185:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788873871.390252:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343990380/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788873871.390258:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859134464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788873871.390521:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873871.390580:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859134336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788873871.390618:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873871.390653:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859134336 00000100:00100000:0.0:1788873871.390657:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859134336 00000100:00100000:0.0:1788873871.390684:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788873871.390689:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859134336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788873871.390705:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788873871.390737:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.390760:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.390780:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788873871.390785:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873871.390791:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.390825:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.390841:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 12 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.390853:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875769859134592:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873871.390917:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873871.394365:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.395182:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840212352 00000100:00100000:0.0:1788873871.395194:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840212352 00000100:00100000:0.0:1788873871.395289:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 76 00000100:00100000:0.0:1788873871.395300:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2400:x1875769840212352:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788873871.397579:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788873871.397856:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:2.0:1788873871.397983:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.398014:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.398968:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.398984:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.398991:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399001:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399158:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d3454571000) 00010000:00010000:2.0:1788873871.399163:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873871.399170:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399177:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9c312 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399229:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399236:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399241:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399247:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.399260:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399267:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399275:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d33410ddd00) 00010000:00010000:2.0:1788873871.399278:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873871.399281:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399287:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c3ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399305:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399311:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399317:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399322:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.399325:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399331:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399339:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:2.0:1788873871.399341:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873871.399350:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399356:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e800/0x25c660afb0a9c438 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399371:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399376:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399381:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399385:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.399388:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399393:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399401:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d3476dc6900) 00010000:00010000:2.0:1788873871.399403:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873871.399406:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399411:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3c00/0x25c660afb0a9c45b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399425:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399439:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399444:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399460:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.399463:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399469:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399477:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873871.399479:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873871.399482:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399487:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c52d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399505:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399511:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399516:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399519:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.399528:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399533:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399540:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:2.0:1788873871.399542:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788873871.399545:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.399550:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c5ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873871.399777:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.400271:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875769859134592:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873871.400300:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.401296:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840212480 00000100:00100000:2.0:1788873871.401307:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840212480 00010000:00010000:2.0:1788873871.401361:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 14 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.401401:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 101 00000100:00100000:2.0:1788873871.401414:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+14:2401:x1875769840212480:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873871.401433:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873871.401439:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 14 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.401467:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 14 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.401496:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae93e1fe/0x25c660afb0a9c3c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.20@tcp remote: 0xad99b647837a98e4 expref: 14 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.401535:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873871.401540:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788873871.401548:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.401560:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.401610:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873871.401681:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+13:2401:x1875769840212480:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 268us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.401700:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 101 00010000:00010000:3.0:1788873871.402305:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.402318:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.402330:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.402338:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.402357:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788873871.402490:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873871.402511:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.402519:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873871.402524:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.402533:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.402547:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.402556:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030f24ec4/0x25c660afb0a9c61b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.402575:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873871.402577:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873871.402579:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873871.404036:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1875769859134336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13331us (13403us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788873871.404048:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1788873871.404162:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3343993800/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788873871.404170:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859134336:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788873871.406361:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788873871.406379:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1788873871.412156:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840212352:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 Request processed in 16845us (17790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.412173:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 76 00000100:00100000:1.0:1788873871.417412:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.417554:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840212736 00000100:00100000:0.0:1788873871.417568:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840212736 00000100:00100000:0.0:1788873871.417677:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 245 00000100:00100000:0.0:1788873871.417689:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12470:x1875769840212736:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.417789:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873871.417837:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c5ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a997e expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.417868:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:0.0:1788873871.417875:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788873871.417919:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.417939:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.417952:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788873871.418136:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b8d749d reply state 000000005d48fdef transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.418151:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.418159:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:0.0:1788873871.418163:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788873871.418166:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788873871.418370:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+22:12470:x1875769840212736:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 680us (977us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788873871.418381:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 245 00000100:00100000:3.0:1788873871.420964:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.421110:0:8789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840212864 00000100:00100000:0.0:1788873871.421145:0:8789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840212864 00000100:00100000:0.0:1788873871.421256:0:8789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 77 00000100:00100000:0.0:1788873871.421271:0:8789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840212864:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788873871.421485:0:8789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788873871.421489:0:8789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788873872 -> 1788873871 00002000:00010000:0.0:1788873871.421493:0:8789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788873871 00002000:00010000:0.0:1788873871.421495:0:8789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788873872 -> 1788873871 00002000:00010000:0.0:1788873871.421498:0:8789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788873871.421581:0:8789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840212864:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 314us (634us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788873871.421599:0:8789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 77 00000100:00100000:1.0:1788873871.423934:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.424175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840213120 00000100:00100000:0.0:1788873871.424190:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840213120 00000100:00100000:0.0:1788873871.424301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 246 00000100:00100000:0.0:1788873871.424317:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+22:12470:x1875769840213120:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.424434:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.424459:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 22 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.424473:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.424521:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 22 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.424540:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 22 pid: 8993 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.424903:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859134720:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873871.425032:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873871.427674:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873871.427855:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840213248 00000100:00100000:0.0:1788873871.427868:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859134720:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788873871.427893:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840213248 00010000:00010000:0.0:1788873871.427913:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.427960:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 23 pid: 8993 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.428042:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 102 00000100:00100000:2.0:1788873871.428055:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+23:2400:x1875769840213248:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873871.428074:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873871.428082:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 23 pid: 8993 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.428134:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 23 pid: 8993 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.428168:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8a00/0x25c660afb0a9c5e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9970 expref: 23 pid: 8993 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.428191:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:2.0:1788873871.428196:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.428275:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.428286:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.428316:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873871.428402:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2400:x1875769840213248:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 349us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.428413:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 102 00010000:00010000:1.0:1788873871.428416:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428429:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428496:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428506:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428515:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428539:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873871.428546:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428556:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428572:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:1.0:1788873871.428576:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788873871.428592:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.428600:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9000/0x25c660afb0a9c629 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873871.428674:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12470:x1875769840213120:12345-192.168.202.20@tcp:55:lhsmtool_posix.0 Request processed in 4360us (4756us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788873871.428684:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 246 00000100:00100000:3.0:1788873871.431559:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.431762:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840213376 00000100:00100000:0.0:1788873871.431785:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840213376 00000100:00100000:0.0:1788873871.431945:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 78 00000100:00100000:0.0:1788873871.431957:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840213376:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788873871.432010:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.432033:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.432042:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788873871.432046:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788873871.432063:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.432114:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.432132:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 8 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.432176:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875769859134848:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788873871.432339:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33427530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873871.449173:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.449372:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875769859134848:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873871.449412:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.449576:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840213504 00000100:00100000:3.0:1788873871.449594:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840213504 00010000:00010000:3.0:1788873871.449655:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 9 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.449708:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 103 00000100:00100000:3.0:1788873871.449739:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+9:2401:x1875769840213504:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873871.449759:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873871.449802:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 9 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.449819:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 9 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.449855:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2385cef/0x25c660afb0a9c60d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a998c expref: 9 pid: 8424 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.449878:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873871.449883:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788873871.449892:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.449907:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.449948:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873871.450034:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2401:x1875769840213504:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 296us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.450043:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 103 00010000:00010000:0.0:1788873871.450280:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450292:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450321:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450331:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450341:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450348:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873871.450353:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450380:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450395:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.450404:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e286b487/0x25c660afb0a9c630 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873871.450470:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2400:x1875769840213376:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 Request processed in 18514us (18929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.450481:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 78 00000100:00100000:1.0:1788873871.453790:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.454022:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840213760 00000100:00100000:3.0:1788873871.454034:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840213760 00000100:00100000:3.0:1788873871.454122:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 247 00000100:00100000:3.0:1788873871.454135:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+21:12470:x1875769840213760:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788873871.454308:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.454333:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.454347:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.454398:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.454415:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 21 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.454432:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859134976:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873871.454531:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450502240 going to sleep for 11 seconds 00000100:00100000:0.0:1788873871.456467:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859134976:192.168.202.20@tcp:104: 00010000:00010000:0.0:1788873871.456506:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873871.462222:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873871.462378:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840213888 00000100:00100000:2.0:1788873871.462393:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840213888 00010000:00010000:2.0:1788873871.462458:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 22 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.462506:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 104 00000100:00100000:2.0:1788873871.462520:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2400:x1875769840213888:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873871.462594:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873871.462605:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 22 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462621:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 22 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462649:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442600/0x25c660afb0a9c526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9938 expref: 22 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462670:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873871.462677:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462690:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462699:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462709:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.462754:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788873871.462912:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.462922:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.463178:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.463193:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.463255:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.463296:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.463313:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.463332:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859135104:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788873871.463445:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450502840 going to sleep for 11 seconds 00000100:00100000:2.0:1788873871.463555:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2400:x1875769840213888:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 1036us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.463565:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 104 00000100:00100000:3.0:1788873871.469695:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859135104:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788873871.469745:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.470465:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873871.476329:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.477075:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840214016 00000100:00100000:3.0:1788873871.477104:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840214016 00010000:00010000:3.0:1788873871.477174:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.477266:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 105 00000100:00100000:3.0:1788873871.477279:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2401:x1875769840214016:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873871.477302:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873871.477311:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.477359:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.477389:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c5f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9977 expref: 22 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.477411:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:3.0:1788873871.477417:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.477429:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.477438:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873871.477470:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873871.477553:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+21:2401:x1875769840214016:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 276us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.477561:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 105 00010000:00010000:0.0:1788873871.477811:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873871.477821:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788873871.477976:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788873871.478123:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788873871.478164:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788873871.478333:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859135232:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788873871.478424:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873871.478476:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859135232 00000100:00100000:0.0:1788873871.478483:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859135232 00000100:00100000:0.0:1788873871.478535:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788873871.478544:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1875769859135232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788873871.482352:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343b73900 going to sleep for 11 seconds 00000100:00100000:2.0:1788873871.482429:0:8450:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788873871.482437:0:8450:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788873871.482468:0:8450:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343990380, transno 4294967322 00000100:00100000:2.0:1788873871.482500:0:8450:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3343993800 x1875769859134336/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788873887 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873871.482515:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859135232:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788873871.482745:0:8450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788873871.483492:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859135360:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788873871.484005:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1875769859135232:12345-0@lo:1000:mdt00_003.0 Request processed in 5457us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.484019:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788873871.484193:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873871.484261:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873871.484398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859135360 00000100:00100000:3.0:1788873871.484409:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859135360 00000100:00100000:3.0:1788873871.484470:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788873871.484481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8450:x1875769859135360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788873871.484839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8450:x1875769859135360:12345-0@lo:1000:mdt00_003.0 Request processed in 359us (1255us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788873871.484847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788873871.485059:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8450:1875769859135360:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788873871.485131:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485143:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485152:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485159:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.485164:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485174:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485196:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:2.0:1788873871.485200:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788873871.485244:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485251:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443200/0x25c660afb0a9c63e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485284:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485292:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485298:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485303:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.485306:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485313:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485322:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873871.485325:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788873871.485335:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485350:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485360:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.485411:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.485426:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859135488:192.168.202.20@tcp:105: 00000100:00100000:2.0:1788873871.485522:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334383d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873871.497966:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873871.498296:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8450:1875769859135488:192.168.202.20@tcp:105: 00010000:00010000:2.0:1788873871.498336:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498351:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8400/0x25c660afb0a9c581 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498397:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498418:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498433:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498447:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498454:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498461:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498491:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.498496:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498504:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498519:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873871.498523:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788873871.498527:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498533:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3400/0x25c660afb0a9c645 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498543:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498549:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498556:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498561:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788873871.498563:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498570:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498601:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873871.498604:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788873871.498607:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.498613:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c637 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.498831:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12470:x1875769840213760:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 44697us (45054us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788873871.498845:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 247 00000020:00080000:2.0:1788873871.498853:0:8450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788873871.499526:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788873871.499534:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788873871.500066:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788873871.500080:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788873871.502540:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840214144 00000100:00100000:3.0:1788873871.502561:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840214144 00000100:00100000:2.0:1788873871.502957:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:2.0:1788873871.502973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12469:x1875769840214144:12345-192.168.202.20@tcp:49:lfs.0 00000100:00100000:2.0:1788873871.503175:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12469:x1875769840214144:12345-192.168.202.20@tcp:49:lfs.0 Request processed in 204us (5223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.503183:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:1.0:1788873871.503425:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873871.504316:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840214400 00000100:00100000:2.0:1788873871.504330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840214400 00000100:00100000:2.0:1788873871.504379:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00100000:2.0:1788873871.504389:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3450edf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+24:12470:x1875769840214400:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788873871.505027:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788873871.505074:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788873871.505132:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.505158:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.505196:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.507068:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.507084:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.507100:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.507136:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788873871.507333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3450edf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+26:12470:x1875769840214400:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 2939us (3903us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788873871.507345:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 62 00000020:00080000:2.0:1788873871.507353:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788873871.511767:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873871.511818:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.511836:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788873871.511876:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.511893:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.511926:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:1.0:1788873871.511930:0:10331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788873871.511939:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.511947:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2600/0x25c660afb0a9c64c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.511984:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873871.511987:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873871.511990:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873871.513987:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873871.514254:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840214656 00000100:00100000:3.0:1788873871.514269:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840214656 00000100:00100000:3.0:1788873871.518270:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 248 00000100:00100000:3.0:1788873871.518313:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+26:12469:x1875769840214656:12345-192.168.202.20@tcp:58:lfs.0 00000040:00080000:3.0:1788873871.518597:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788873871.518729:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+26:12469:x1875769840214656:12345-192.168.202.20@tcp:58:lfs.0 Request processed in 440us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873871.518739:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 248 00000100:00100000:0.0:1788873871.574013:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873871.574331:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840214784 00000100:00100000:1.0:1788873871.574345:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840214784 00000100:00100000:1.0:1788873871.574421:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 249 00000100:00100000:1.0:1788873871.574433:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+26:12472:x1875769840214784:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788873871.574466:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873871.574497:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9993 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574583:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574602:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574643:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574663:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574671:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574679:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574808:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.574822:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.575003:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.575052:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.575070:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 27 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873871.575086:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859135616:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788873871.575284:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342b82e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873871.579850:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873871.580304:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840215040 00000100:00100000:0.0:1788873871.580318:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840215040 00000100:00100000:0.0:1788873871.580398:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:0.0:1788873871.580421:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+28:6173:x1875769840215040:12345-192.168.202.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788873871.580786:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+29:6173:x1875769840215040:12345-192.168.202.20@tcp:35:ldlm_bl.0 Request processed in 367us (961us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788873871.580796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:1.0:1788873871.581870:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875769859135616:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788873871.581917:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873871.583173:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873871.583305:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840215168 00000100:00100000:2.0:1788873871.583318:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840215168 00010000:00010000:2.0:1788873871.583369:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 29 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873871.583424:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 106 00000100:00100000:2.0:1788873871.583434:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+29:2401:x1875769840215168:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873871.583452:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873871.583460:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 29 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.583501:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 29 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.583529:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9c00/0x25c660afb0a9c573 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9954 expref: 29 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.583548:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873871.583555:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.583567:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.583577:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873871.583625:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873871.583696:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+28:2401:x1875769840215168:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 263us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.583704:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 106 00010000:00010000:1.0:1788873871.584430:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584445:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788873871.584525:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788873871.584531:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788873871.584559:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584590:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584603:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584612:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584620:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584627:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873871.584632:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584642:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584671:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:1.0:1788873871.584674:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873871.584680:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584687:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9c65a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584704:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584711:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584717:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584723:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873871.584726:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584733:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584741:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d33410dd000) 00010000:00010000:1.0:1788873871.584743:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873871.584747:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584753:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb000/0x25c660afb0a9c661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584815:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9c653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9993 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584902:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9993 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873871.584912:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:1.0:1788873871.584914:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788873871.584923:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecae00, rc 0) 00000100:00100000:1.0:1788873871.585067:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12472:x1875769840214784:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 10636us (11074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873871.585078:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 249 00000100:00100000:0.0:1788873871.599177:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859135744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873871.599361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873871.599464:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859135744 00000100:00100000:0.0:1788873871.599475:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859135744 00000100:00100000:0.0:1788873871.599538:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788873871.599549:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859135744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788873871.599619:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:0.0:1788873871.599680:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859135744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873871.599689:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788873871.599743:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788873871.599750:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:0.0:1788873871.603328:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343991500, transno 4294967308 00000004:00080000:0.0:1788873871.603357:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1788873871.603385:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343afe300, transno 4294967311 00000100:00100000:0.0:1788873871.603420:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859135744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873871.604102:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859135872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873871.604232:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873871.604299:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859135872 00000100:00100000:2.0:1788873871.604308:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859135872 00000100:00100000:2.0:1788873871.604381:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788873871.604392:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859135872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873871.604422:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788873871.604500:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859135872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873871.604508:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788873871.604544:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873871.604583:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859135872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873872.115436:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859136384:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115509:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115565:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859136896:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115592:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115611:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859137408:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115632:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115665:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788873872.115672:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859136000:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115703:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115732:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859136512:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115755:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115770:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859137024:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115790:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115805:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859137536:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115824:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.115856:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136384 00000100:00100000:2.0:1788873872.115864:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136384 00000100:00100000:2.0:1788873872.115909:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788873872.115919:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859136384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.115983:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859136384:12345-0@lo:400:kworker.0 Request processed in 65us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116005:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788873872.116053:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859136384:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116124:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859136128:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116150:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.116167:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859136640:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.116200:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859137152:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116242:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.116261:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788873872.116267:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859136256:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116289:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.116306:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859136768:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.116338:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859137280:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116358:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873872.116382:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136128 00000100:00100000:2.0:1788873872.116386:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136128 00000100:00100000:2.0:1788873872.116405:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136640 00000100:00100000:2.0:1788873872.116408:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136640 00000100:00100000:2.0:1788873872.116427:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137152 00000100:00100000:2.0:1788873872.116430:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137152 00000100:00100000:2.0:1788873872.116442:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136768 00000100:00100000:2.0:1788873872.116444:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136768 00000100:00100000:2.0:1788873872.116456:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137280 00000100:00100000:2.0:1788873872.116459:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137280 00000100:00100000:2.0:1788873872.116471:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788873872.116486:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859136128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116519:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859136128:12345-0@lo:400:kworker.0 Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116525:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788873872.116539:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788873872.116545:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859136640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116568:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859136640:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116575:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788873872.116586:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788873872.116592:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859137152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116616:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859137152:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116622:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788873872.116633:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788873872.116639:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859136768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116665:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859136768:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116671:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788873872.116682:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788873872.116688:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859137280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116711:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859137280:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116717:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:2.0:1788873872.116733:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873872.116743:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788873872.116764:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a0700 x1875769859136768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873872.116775:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859136768:0@lo:400:kworker.0 00010000:00080000:2.0:1788873872.116784:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f3a3100 x1875769859137280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873872.116792:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859137280:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116801:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859136128:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116810:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859136640:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116818:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859137152:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116862:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136000 00000100:00100000:2.0:1788873872.116866:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136000 00000100:00100000:2.0:1788873872.116894:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788873872.116900:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859136000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116933:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3633:x1875769859136000:12345-0@lo:400:kworker.0 Request processed in 33us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.116940:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788873872.116974:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859136000:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.116999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136512 00000100:00100000:2.0:1788873872.117002:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136512 00000100:00100000:2.0:1788873872.117026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136256 00000100:00100000:2.0:1788873872.117029:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136256 00000100:00100000:2.0:1788873872.117041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788873872.117047:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859136512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.117106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859136512:12345-0@lo:400:kworker.0 Request processed in 59us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.117113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788873872.117126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788873872.117132:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859136256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.117162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859136256:12345-0@lo:400:kworker.0 Request processed in 31us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.117168:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788873872.117190:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859136256:0@lo:400:kworker.0 00000100:00100000:2.0:1788873872.117234:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859136512:0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117605:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859136896 00000100:00100000:1.0:1788873872.117610:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859136896 00000100:00100000:1.0:1788873872.117633:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137408 00000100:00100000:1.0:1788873872.117636:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137408 00000100:00100000:1.0:1788873872.117667:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137024 00000100:00100000:1.0:1788873872.117671:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137024 00000100:00100000:1.0:1788873872.117682:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137536 00000100:00100000:1.0:1788873872.117685:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137536 00000100:00100000:1.0:1788873872.117698:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788873872.117705:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859136896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117752:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859136896:12345-0@lo:400:kworker.0 Request processed in 47us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873872.117758:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788873872.117770:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788873872.117776:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859137408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117813:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859137408:12345-0@lo:400:kworker.0 Request processed in 38us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873872.117820:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788873872.117831:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788873872.117837:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859137024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117863:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859137024:12345-0@lo:400:kworker.0 Request processed in 26us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873872.117869:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788873872.117878:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788873872.117884:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859137536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117908:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859137536:12345-0@lo:400:kworker.0 Request processed in 24us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873872.117914:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788873872.117951:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859137024:0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117964:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859137536:0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117974:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859136896:0@lo:400:kworker.0 00000100:00100000:1.0:1788873872.117984:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859137408:0@lo:400:kworker.0 00000100:00080000:2.0:1788873872.118515:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788873872.118520:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788873872.463884:0:14704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873872.463895:0:14704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788873872.463927:0:14704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788873872.463932:0:14704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788873872.494659:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873872.565808:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788873872.565819:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788873872.565844:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788873872.565851:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788873872.565990:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859137664:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788873872.566106:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345119fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873872.575844:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1875769859137664:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788873872.578657:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873872.579001:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840215296 00000100:00100000:0.0:1788873872.579010:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840215296 00000100:00100000:0.0:1788873872.579075:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 250 00000100:00100000:0.0:1788873872.579095:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12484:x1875769840215296:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788873872.579133:0:8450:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788873872.579361:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12484:x1875769840215296:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 268us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873872.579370:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 250 00000100:00100000:2.0:1788873872.600415:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873872.600497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840215552 00000100:00100000:0.0:1788873872.600508:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840215552 00000100:00100000:0.0:1788873872.600571:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 251 00000100:00100000:0.0:1788873872.600582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+27:12484:x1875769840215552:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788873872.600601:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873872.600624:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c66f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a999a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873872.600751:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873872.600768:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873872.600781:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788873872.600792:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788873872.600899:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9e00/0x25c660afb0a9c66f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a999a expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873872.600915:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a999a expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873872.600925:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873872.600929:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873872.600932:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8000, rc 0) 00000100:00100000:0.0:1788873872.600988:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+29:12484:x1875769840215552:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 407us (584us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788873872.600995:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 251 00000100:00100000:1.0:1788873872.621133:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873872.621551:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840215936 00000100:00100000:3.0:1788873872.621562:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840215936 00000100:00100000:3.0:1788873872.621945:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:3.0:1788873872.621957:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+29:2401:x1875769840215936:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788873872.621972:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873872.621999:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad8000/0x25c660afb0a9c676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a999a expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.622016:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873872.622022:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873872.622073:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+28:2401:x1875769840215936:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 120us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873872.622108:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:0.0:1788873872.622284:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873872.622903:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840215808 00000100:00100000:3.0:1788873872.622912:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840215808 00000100:00100000:3.0:1788873872.622959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 252 00000100:00100000:3.0:1788873872.622967:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+28:12484:x1875769840215808:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788873872.623043:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.623061:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.623073:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873872.623383:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873872.623401:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859137792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873872.623454:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873872.625362:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859137920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873872.625449:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873872.625506:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137920 00000100:00100000:0.0:1788873872.625513:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137920 00000100:00100000:0.0:1788873872.625553:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788873872.625561:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859137920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873872.626040:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788873872.626106:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859137920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 545us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873872.626114:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:3.0:1788873872.626278:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.626290:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.626298:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.626304:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788873872.626309:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.626317:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.626335:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:3.0:1788873872.626347:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788873872.626353:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873872.626360:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442e00/0x25c660afb0a9c684 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873872.626488:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+29:12484:x1875769840215808:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 3519us (4201us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788873872.626497:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 252 00000100:00100000:0.0:1788873872.627257:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859137920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788873872.627435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859137792 00000100:00100000:2.0:1788873872.627442:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859137792 00000100:00100000:2.0:1788873872.627482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788873872.627491:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859137792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873872.627522:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788873872.627927:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859138048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788873872.628059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859137792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 569us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873872.628067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788873872.628291:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873872.628340:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138048 00000100:00100000:1.0:1788873872.628345:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138048 00000100:00100000:1.0:1788873872.628375:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788873872.628382:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859138048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873872.628398:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788873872.628431:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859138048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873872.628437:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788873872.628474:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859138048:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788873872.629038:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873872.629043:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788873872.629329:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859137792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873872.632246:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873872.632400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216192 00000100:00100000:2.0:1788873872.632411:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216192 00000100:00100000:2.0:1788873872.632476:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:2.0:1788873872.632487:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+29:12484:x1875769840216192:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1788873872.635265:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788873872.635282:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788873872.635812:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+30:12484:x1875769840216192:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 3320us (3569us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788873872.635826:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:1.0:1788873873.033637:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033689:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033725:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033755:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033774:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033801:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033828:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873873.033859:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216576 00000100:00100000:1.0:1788873873.033870:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216576 00000100:00100000:1.0:1788873873.033923:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217088 00000100:00100000:1.0:1788873873.033926:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217088 00000100:00100000:1.0:1788873873.033937:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216448 00000100:00100000:1.0:1788873873.033939:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216448 00000100:00100000:1.0:1788873873.033951:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216960 00000100:00100000:1.0:1788873873.033968:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216960 00000100:00100000:1.0:1788873873.033987:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 340 00000100:00100000:1.0:1788873873.033999:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840216576:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873873.034073:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840216576:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873873.034093:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 340 00000100:00100000:1.0:1788873873.034112:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 341 00000100:00100000:1.0:1788873873.034119:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840217088:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873873.034144:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840217088:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873873.034151:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 341 00000100:00100000:1.0:1788873873.034162:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 342 00000100:00100000:1.0:1788873873.034169:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+30:2398:x1875769840216448:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873873.034197:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+30:2398:x1875769840216448:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873873.034250:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 342 00000100:00100000:1.0:1788873873.034263:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 343 00000100:00100000:1.0:1788873873.034269:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840216960:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873873.034294:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840216960:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873873.034300:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 343 00000100:00100000:1.0:1788873873.034321:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216832 00000100:00100000:1.0:1788873873.034325:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216832 00000100:00100000:1.0:1788873873.034471:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216704 00000100:00100000:1.0:1788873873.034480:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216704 00000100:00100000:1.0:1788873873.034506:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 132 00000100:00100000:1.0:1788873873.034513:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d344ff4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2398:x1875769840216832:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873873.034547:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d344ff4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2398:x1875769840216832:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 34us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873873.034554:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 132 00000100:00100000:1.0:1788873873.034698:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 133 00000100:00100000:1.0:1788873873.034705:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840216704:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873873.034728:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840216704:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873873.034734:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 133 00000100:00100000:2.0:1788873873.035028:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840216320 00000100:00100000:2.0:1788873873.035033:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840216320 00000100:00100000:2.0:1788873873.035073:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 389 00000100:00100000:2.0:1788873873.035091:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840216320:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873873.035123:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840216320:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 34us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873873.035130:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 389 00000100:00080000:2.0:1788873873.035164:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788873873.035168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873873.035170:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788873873.035173:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788873873.523923:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788873874.317717:0:14756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788873874.317727:0:14756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788873874.318973:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788873874.318983:0:14756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788873874.544334:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873874.579289:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873874.579375:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217344 00000100:00100000:2.0:1788873874.579386:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217344 00000100:00100000:2.0:1788873874.579452:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 253 00000100:00100000:2.0:1788873874.579463:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+30:12504:x1875769840217344:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788873874.579486:0:8993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873874.579512:0:8993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3000/0x25c660afb0a9c68b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a99a1 expref: -99 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873874.579632:0:8993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c692 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873874.579648:0:8993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873874.579674:0:8993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788873874.579687:0:8993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788873874.579793:0:8993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b3000/0x25c660afb0a9c68b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99a1 expref: 33 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873874.579812:0:8993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99a1 expref: 32 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873874.579821:0:8993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:2.0:1788873874.579824:0:8993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788873874.579827:0:8993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2a00, rc 0) 00000100:00100000:2.0:1788873874.579893:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+32:12504:x1875769840217344:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 433us (614us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788873874.579901:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 253 00000100:00100000:1.0:1788873874.592161:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873874.592291:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217472 00000100:00100000:0.0:1788873874.592304:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217472 00000100:00100000:0.0:1788873874.592380:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 254 00000100:00100000:0.0:1788873874.592391:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+32:12504:x1875769840217472:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:0.0:1788873874.592471:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592492:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592506:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592544:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592552:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592574:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592581:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788873874.592593:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592603:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592617:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873874.592620:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788873874.592626:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873874.592634:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9a00/0x25c660afb0a9c6a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873874.592710:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+32:12504:x1875769840217472:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 321us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873874.592718:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 254 00000100:00100000:1.0:1788873874.766844:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873874.768008:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217600 00000100:00100000:2.0:1788873874.768269:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217600 00000100:00100000:3.0:1788873874.770471:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 79 00000100:00100000:3.0:1788873874.770487:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2399:x1875769840217600:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:3.0:1788873874.770508:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873874.770531:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ef6192/0x25c660afb0a9c6a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a99a8 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788873874.770564:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa00c8f, atime: 0x6aa00c8f, ctime: 0x6aa00c8f, blocks: 0x8 00010000:00010000:3.0:1788873874.770588:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1788873874.770594:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788873874.770621:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ef6192/0x25c660afb0a9c6a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99a8 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873874.770642:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2ef6192/0x25c660afb0a9c6a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99a8 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873874.770658:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442e00, rc 0) 00000100:00100000:3.0:1788873874.770740:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2399:x1875769840217600:12345-192.168.202.20@tcp:101:cat.0 Request processed in 256us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873874.770748:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 79 00000100:00100000:1.0:1788873874.774957:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873874.775053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217728 00000100:00100000:3.0:1788873874.775073:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217728 00002000:00100000:3.0:1788873874.775134:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9d3343887800 x1875769840217728/t0(0) o3->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:290/0 lens 488/0 e 0 to 0 dl 1788873885 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788873874.775146:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3343887800 with x1875769840217728 ext(0->4095) 00002000:00010000:3.0:1788873874.775152:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3343887800 00000100:00100000:3.0:1788873874.775189:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:3.0:1788873874.775201:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840217728:12345-192.168.202.20@tcp:3:cat.0 00000100:00100000:3.0:1788873874.775403:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+8:2400:x1875769840217728:12345-192.168.202.20@tcp:3:cat.0 Request processed in 203us (455us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788873874.775411:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00002000:00100000:3.0:1788873874.775418:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9d3343887800 x1875769840217728/t0(0) o3->64e5d878-4280-4742-8a19-a12ccf17cae7@192.168.202.20@tcp:290/0 lens 488/4536 e 0 to 0 dl 1788873885 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788873874.775427:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3343887800 with x1875769840217728 ext(0->4095) 00002000:00010000:3.0:1788873874.775431:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3343887800 00000100:00100000:1.0:1788873875.183047:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873875.183100:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859138176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873875.183191:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873875.183443:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138176 00000100:00100000:0.0:1788873875.183451:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138176 00000100:00100000:0.0:1788873875.183503:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788873875.183515:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859138176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873875.183550:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788873875.183610:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859138176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873875.183617:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788873875.183854:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859138176:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788873875.566582:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873876.592365:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873876.719867:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859138304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873876.719940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873876.720009:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138304 00000100:00100000:2.0:1788873876.720017:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138304 00000100:00100000:2.0:1788873876.720085:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788873876.720094:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859138304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873876.720125:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873876.720173:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859138304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873876.720190:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788873876.720239:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873876.720277:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859138304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873876.722990:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859138432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788873876.723072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873876.728862:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138432 00000100:00100000:3.0:1788873876.728881:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138432 00000100:00100000:3.0:1788873876.728974:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788873876.728984:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859138432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788873876.729010:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788873876.730560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873876.733613:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859138432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4621us (10532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873876.733628:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788873876.738660:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859138432:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788873877.233979:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788873877.234021:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d334383d600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788873877.234027:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a6a3100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d334383d240 00000020:00080000:3.0:1788873877.234030:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d347a6a3400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3344170a00 00000020:00080000:3.0:1788873877.234065:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788873877.234134:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873877.234146:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873877.234154:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873877.234179:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788873877.234184:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873877.234192:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873877.234232:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d33410e1d00) 00010000:00010000:1.0:1788873877.234236:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788873877.234242:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873877.234249:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3343ad9800/0x25c660afb0a9c622 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788873877.234856:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788873877.234936:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788873877.236284:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859138944:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236366:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.236435:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859139456:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236463:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.236492:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139456 00000100:00100000:2.0:1788873877.236500:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139456 00000100:00100000:2.0:1788873877.236550:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788873877.236559:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859139456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236606:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859139456:12345-0@lo:400:kworker.0 Request processed in 48us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.236613:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788873877.236666:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859139456:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236684:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788873877.236691:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859138816:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236715:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.236752:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138816 00000100:00100000:2.0:1788873877.236755:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138816 00000100:00100000:2.0:1788873877.236781:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788873877.236786:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859138816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236820:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859138816:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.236826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788873877.236854:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859138816:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236861:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859139328:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.236902:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138944 00000100:00100000:2.0:1788873877.236905:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138944 00000100:00100000:2.0:1788873877.236931:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139328 00000100:00100000:2.0:1788873877.236934:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139328 00000100:00100000:2.0:1788873877.236957:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788873877.236963:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859138944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.236990:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859138944:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.236996:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788873877.237008:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788873877.237013:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859139328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237046:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875769859139328:12345-0@lo:400:kworker.0 Request processed in 22us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.237052:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:2.0:1788873877.237071:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788873877.237088:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475d93480 x1875769859139328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873877.237111:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1875769859139328:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237122:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859138944:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237181:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859138688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.237258:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859139200:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237277:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.237292:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788873877.237298:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859138560:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.237347:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859139072:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237368:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.237384:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859139584:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873877.237428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138688 00000100:00100000:2.0:1788873877.237432:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138688 00000100:00100000:2.0:1788873877.237454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139200 00000100:00100000:2.0:1788873877.237457:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139200 00000100:00100000:2.0:1788873877.237477:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788873877.237483:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859138688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237516:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859138688:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.237522:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788873877.237535:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788873877.237544:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859139200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859139200:12345-0@lo:400:kworker.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.237583:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788873877.237600:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859138560 00000100:00100000:2.0:1788873877.237603:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859138560 00000100:00100000:2.0:1788873877.237622:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788873877.237627:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859138560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237650:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859138560:12345-0@lo:400:kworker.0 Request processed in 23us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.237656:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788873877.237676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139072 00000100:00100000:2.0:1788873877.237679:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139072 00000100:00100000:2.0:1788873877.237698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788873877.237704:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859139072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237732:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859139072:12345-0@lo:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.237738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788873877.237755:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139584 00000100:00100000:2.0:1788873877.237758:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139584 00000100:00100000:2.0:1788873877.237779:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788873877.237784:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859139584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237809:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859139584:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873877.237815:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1788873877.237836:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873877.237854:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859138560:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237873:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859139072:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237881:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859139584:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237888:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859138688:0@lo:400:kworker.0 00000100:00100000:2.0:1788873877.237896:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859139200:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238311:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859140096:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238342:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873877.238362:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873877.238367:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859139712:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238384:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873877.238672:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140096 00000100:00100000:0.0:1788873877.238679:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140096 00000100:00100000:0.0:1788873877.238728:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788873877.238735:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859140096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238775:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3633:x1875769859140096:12345-0@lo:400:kworker.0 Request processed in 40us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873877.238782:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788873877.238815:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859140096:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238835:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859139840:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873877.238878:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873877.238883:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859139968:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238904:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873877.238926:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139968 00000100:00100000:0.0:1788873877.238929:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139968 00000100:00100000:0.0:1788873877.238961:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788873877.238968:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859139968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.238998:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859139968:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873877.239004:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788873877.239022:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139712 00000100:00100000:0.0:1788873877.239046:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139712 00000100:00100000:0.0:1788873877.239073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859139840 00000100:00100000:0.0:1788873877.239076:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859139840 00000100:00100000:0.0:1788873877.239095:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788873877.239101:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859139712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.239132:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859139712:12345-0@lo:400:kworker.0 Request processed in 32us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873877.239138:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788873877.239149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788873877.239155:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859139840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788873877.239545:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873877.239549:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873877.239552:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788873877.242326:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788873877.242350:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:0.0:1788873877.242866:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859139840:12345-0@lo:400:kworker.0 Request processed in 3706us (4001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873877.242879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788873877.242941:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859139712:0@lo:400:kworker.0 00000100:00100000:0.0:1788873877.242988:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859139968:0@lo:400:kworker.0 00010000:00080000:0.0:1788873877.243001:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f42c000 x1875769859139840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873877.243011:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859139840:0@lo:400:kworker.0 00010000:00010000:2.0:1788873877.616477:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873877.744448:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859140224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873877.744534:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873877.744668:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140224 00000100:00100000:3.0:1788873877.744676:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140224 00000100:00100000:3.0:1788873877.744733:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788873877.744744:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859140224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873877.744785:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788873877.744848:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859140224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873877.744855:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788873877.744919:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859140224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873877.745152:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873877.745163:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859140352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873877.745196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873877.745255:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140352 00000100:00100000:1.0:1788873877.745260:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140352 00000100:00100000:1.0:1788873877.745288:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788873877.745294:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859140352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873877.745314:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788873877.745348:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859140352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873877.745354:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788873877.745384:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859140352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873877.745529:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873877.745538:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859140480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873877.745565:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873877.745640:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140480 00000100:00100000:3.0:1788873877.745644:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140480 00000100:00100000:3.0:1788873877.745678:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788873877.745686:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859140480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873877.745697:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788873877.745732:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859140480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873877.745738:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788873877.745806:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788873877.745812:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3343993800, transno 4294967323 00000004:00080000:0.0:1788873877.745841:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788873877.745867:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859140480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873878.162256:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162579:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162617:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162636:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162656:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162674:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873878.162725:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218240 00000100:00100000:0.0:1788873878.162735:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218240 00000100:00100000:0.0:1788873878.162791:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218368 00000100:00100000:0.0:1788873878.162794:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218368 00000100:00100000:0.0:1788873878.162820:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:0.0:1788873878.162831:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840218240:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873878.162910:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2400:x1875769840218240:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873878.162919:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:0.0:1788873878.162939:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 139 00000100:00100000:0.0:1788873878.162945:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840218368:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873878.162969:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2401:x1875769840218368:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873878.162976:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 139 00000100:00100000:0.0:1788873878.162997:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217984 00000100:00100000:0.0:1788873878.163001:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217984 00000100:00100000:0.0:1788873878.163038:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218112 00000100:00100000:0.0:1788873878.163055:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218112 00000100:00100000:0.0:1788873878.163070:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218496 00000100:00100000:0.0:1788873878.163072:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218496 00000100:00100000:1.0:1788873878.163410:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218624 00000100:00100000:1.0:1788873878.163422:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218624 00000100:00100000:1.0:1788873878.163449:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 350 00000100:00100000:1.0:1788873878.163456:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2400:x1875769840217984:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873878.163495:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2400:x1875769840217984:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 39us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873878.163501:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 350 00000100:00100000:1.0:1788873878.163514:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 351 00000100:00100000:1.0:1788873878.163520:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840218112:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873878.163545:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2401:x1875769840218112:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873878.163551:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 351 00000100:00100000:1.0:1788873878.163563:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 352 00000100:00100000:1.0:1788873878.163569:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840218624:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873878.163591:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2401:x1875769840218624:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 22us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873878.163597:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 352 00000100:00100000:3.0:1788873878.164281:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840217856 00000100:00100000:3.0:1788873878.164288:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840217856 00000100:00100000:3.0:1788873878.165251:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 391 00000100:00100000:3.0:1788873878.165262:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840217856:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873878.165541:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2401:x1875769840217856:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 280us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873878.165549:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 391 00000100:00080000:3.0:1788873878.165586:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873878.165593:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873878.165596:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788873878.165598:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873878.165784:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 353 00000100:00100000:0.0:1788873878.165793:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840218496:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788873878.165829:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2400:x1875769840218496:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 38us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873878.165835:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 353 00000040:00080000:0.0:1788873878.191100:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788873878.638395:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788873878.830588:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788873878.830598:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788873878.830619:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788873878.830626:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788873879.664031:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873880.306236:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859140608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873880.306321:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873880.306442:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140608 00000100:00100000:2.0:1788873880.306450:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140608 00000100:00100000:2.0:1788873880.306508:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788873880.306517:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859140608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873880.306552:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788873880.313335:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859140608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873880.313808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859140608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7288us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873880.313821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00010000:2.0:1788873880.694061:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873880.905928:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873880.906048:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218752 00000100:00100000:2.0:1788873880.906061:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218752 00000100:00100000:2.0:1788873880.906142:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 255 00000100:00100000:2.0:1788873880.906155:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12157:x1875769840218752:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788873880.906301:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12157:x1875769840218752:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 Request processed in 149us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873880.906310:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 255 00000100:00080000:3.0:1788873880.906661:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873880.934184:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873880.934400:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840218880 00000100:00100000:2.0:1788873880.934411:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840218880 00000100:00100000:2.0:1788873880.934503:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 256 00000100:00100000:2.0:1788873880.934516:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:12157:x1875769840218880:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788873880.934661:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:12157:x1875769840218880:12345-192.168.202.20@tcp:60:lhsmtool_posix.0 Request processed in 148us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873880.934669:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 256 00000100:00080000:3.0:1788873880.938325:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788873880.946256:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873880.946490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219136 00000100:00100000:2.0:1788873880.946502:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219136 00000100:00100000:2.0:1788873880.946565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:2.0:1788873880.946577:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+18:12157:x1875769840219136:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788873880.946823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+19:12157:x1875769840219136:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 247us (632us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788873880.946831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 65 00000100:00100000:1.0:1788873881.177136:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873881.177241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219264 00000100:00100000:3.0:1788873881.177253:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219264 00000100:00100000:3.0:1788873881.177603:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 257 00000100:00100000:3.0:1788873881.177615:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:12962:x1875769840219264:12345-192.168.202.20@tcp:101:lsof.0 00010000:00010000:3.0:1788873881.177653:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873881.177690:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c6ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a99af expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873881.177762:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c6b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873881.177777:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873881.177791:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788873881.177839:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788873881.177844:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788873881.177863:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873881.177886:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442800/0x25c660afb0a9c6ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99af expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873881.177904:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99af expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873881.177912:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:3.0:1788873881.177915:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873881.177919:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873881.177985:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:12962:x1875769840219264:12345-192.168.202.20@tcp:101:lsof.0 Request processed in 372us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873881.177992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 257 00000100:00080000:0.0:1788873881.181628:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788873881.710528:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873881.838545:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859140736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873881.838626:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873881.838956:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140736 00000100:00100000:2.0:1788873881.838965:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140736 00000100:00100000:2.0:1788873881.839058:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788873881.839069:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859140736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873881.839097:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873881.839143:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859140736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873881.839149:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788873881.839234:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873881.839275:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859140736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873881.839741:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873881.839752:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859140864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788873881.839798:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873881.840035:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140864 00000100:00100000:1.0:1788873881.840042:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140864 00000100:00100000:1.0:1788873881.840090:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788873881.840098:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859140864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788873881.840113:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873881.840152:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859140864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873881.840179:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788873881.840238:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859140864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788873881.840296:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873882.351087:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859141376:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351255:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859141888:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351301:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351319:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859142400:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351338:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351364:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788873882.351370:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859140992:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351399:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351422:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859141504:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351444:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351459:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859142016:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351504:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859142528:0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351524:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.351553:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859140992 00000100:00100000:2.0:1788873882.351561:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859140992 00000100:00100000:2.0:1788873882.351605:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788873882.351617:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859140992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873882.351668:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859140992:12345-0@lo:400:kworker.0 Request processed in 54us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873882.351675:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788873882.351734:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859140992:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352005:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859141120:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352041:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.352072:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859141632:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352095:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.352112:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859142144:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352133:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.352153:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788873882.352159:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859141248:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352182:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.352199:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859141760:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352258:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.352278:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859142272:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352298:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.352321:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141888 00000100:00100000:0.0:1788873882.352326:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141888 00000100:00100000:0.0:1788873882.352353:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142400 00000100:00100000:0.0:1788873882.352356:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142400 00000100:00100000:0.0:1788873882.352375:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142016 00000100:00100000:0.0:1788873882.352378:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142016 00000100:00100000:0.0:1788873882.352389:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142528 00000100:00100000:0.0:1788873882.352392:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142528 00000100:00100000:0.0:1788873882.352409:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788873882.352416:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859141888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352460:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859141888:12345-0@lo:400:kworker.0 Request processed in 44us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.352467:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788873882.352483:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788873882.352504:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859142400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352534:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859142400:12345-0@lo:400:kworker.0 Request processed in 31us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.352540:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788873882.352551:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788873882.352556:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859142016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352583:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859142016:12345-0@lo:400:kworker.0 Request processed in 27us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.352589:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788873882.352599:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788873882.352612:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859142528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352641:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859142528:12345-0@lo:400:kworker.0 Request processed in 30us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.352646:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788873882.352668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141504 00000100:00100000:0.0:1788873882.352671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141504 00000100:00100000:0.0:1788873882.352691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141248 00000100:00100000:0.0:1788873882.352694:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141248 00000100:00100000:0.0:1788873882.352706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788873882.352712:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859141504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352743:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859141504:12345-0@lo:400:kworker.0 Request processed in 31us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.352749:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788873882.352760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788873882.352765:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859141248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.352799:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859141248:12345-0@lo:400:kworker.0 Request processed in 34us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.352805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788873882.352824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141376 00000100:00100000:0.0:1788873882.352827:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141376 00000100:00100000:0.0:1788873882.352845:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141120 00000100:00100000:0.0:1788873882.352847:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141120 00000100:00100000:0.0:1788873882.354015:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141632 00000100:00100000:0.0:1788873882.354025:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141632 00000100:00100000:0.0:1788873882.354041:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142144 00000100:00100000:0.0:1788873882.354043:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142144 00000100:00100000:0.0:1788873882.354057:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859141760 00000100:00100000:0.0:1788873882.354060:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859141760 00000100:00100000:0.0:1788873882.354070:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142272 00000100:00100000:0.0:1788873882.354086:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142272 00000100:00100000:0.0:1788873882.354107:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788873882.354116:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859141376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354181:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859141376:12345-0@lo:400:kworker.0 Request processed in 67us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.354188:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788873882.354231:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788873882.354237:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859141120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354266:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859141120:12345-0@lo:400:kworker.0 Request processed in 30us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.354272:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788873882.354283:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788873882.354289:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859141632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354313:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859141632:12345-0@lo:400:kworker.0 Request processed in 26us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.354317:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788873882.354325:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788873882.354328:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859142144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354344:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859142144:12345-0@lo:400:kworker.0 Request processed in 16us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.354347:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788873882.354353:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788873882.354357:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859141760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354370:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859141760:12345-0@lo:400:kworker.0 Request processed in 14us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.354381:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788873882.354388:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788873882.354392:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859142272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354409:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859142272:12345-0@lo:400:kworker.0 Request processed in 17us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.354412:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788873882.354456:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859141248:0@lo:400:kworker.0 00010000:00080000:0.0:1788873882.354468:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475d93480 x1875769859141760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873882.354476:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859141760:0@lo:400:kworker.0 00010000:00080000:0.0:1788873882.354485:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33441b8e00 x1875769859142272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873882.354493:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859142272:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354503:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859141120:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354513:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859141632:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354522:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859142144:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354567:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859141504:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354576:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859142016:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354582:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859142528:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354590:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859141376:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354605:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859141888:0@lo:400:kworker.0 00000100:00100000:0.0:1788873882.354612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859142400:0@lo:400:kworker.0 00000100:00080000:3.0:1788873882.356303:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873882.356310:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873882.356312:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788873882.734493:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873882.862931:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859142656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873882.863190:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873882.863343:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142656 00000100:00100000:2.0:1788873882.863352:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142656 00000100:00100000:2.0:1788873882.863409:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788873882.863420:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859142656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873882.863462:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788873882.863525:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859142656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873882.863532:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788873882.863598:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859142656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873882.864423:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859142784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873882.864465:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.864604:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859142912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873882.864635:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873882.864687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142912 00000100:00100000:0.0:1788873882.864692:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142912 00000100:00100000:0.0:1788873882.864728:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788873882.864736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859142912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873882.864764:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873882.864802:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859142912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873882.864808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788873882.864846:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859142912:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788873882.869693:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788873882.869713:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788873882.869814:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788873882.869828:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788873882.870248:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859142784 00000100:00100000:1.0:1788873882.870263:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859142784 00000100:00100000:1.0:1788873882.870336:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788873882.870346:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859142784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788873882.870372:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788873882.870467:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859142784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (6001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873882.870473:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788873882.870567:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859142784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873883.281198:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281272:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281312:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281344:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281359:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281377:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281400:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873883.281426:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219904 00000100:00100000:1.0:1788873883.281436:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219904 00000100:00100000:1.0:1788873883.281489:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219776 00000100:00100000:1.0:1788873883.281492:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219776 00000100:00100000:1.0:1788873883.281516:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 144 00000100:00100000:1.0:1788873883.281526:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2398:x1875769840219904:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873883.281533:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219648 00000100:00100000:2.0:1788873883.281538:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219648 00000100:00100000:2.0:1788873883.281568:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840220160 00000100:00100000:2.0:1788873883.281570:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840220160 00000100:00100000:2.0:1788873883.281581:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219520 00000100:00100000:2.0:1788873883.281584:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219520 00000100:00100000:2.0:1788873883.281595:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840220032 00000100:00100000:2.0:1788873883.281597:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840220032 00000100:00100000:1.0:1788873883.281603:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2398:x1875769840219904:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873883.281612:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 144 00000100:00100000:2.0:1788873883.281627:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 360 00000100:00100000:2.0:1788873883.281633:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840219648:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873883.281644:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 145 00000100:00100000:1.0:1788873883.281649:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840219776:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873883.281675:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840219648:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 41us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873883.281675:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2398:x1875769840219776:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873883.281681:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 145 00000100:00100000:2.0:1788873883.281682:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 360 00000100:00100000:2.0:1788873883.281702:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 361 00000100:00100000:2.0:1788873883.281708:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840220160:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788873883.281733:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840220160:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873883.281781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840219392 00000100:00100000:3.0:1788873883.281786:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840219392 00000100:00100000:3.0:1788873883.281818:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 393 00000100:00100000:3.0:1788873883.281825:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840219392:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788873883.281857:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2398:x1875769840219392:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 33us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873883.281862:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 393 00000100:00100000:1.0:1788873883.286185:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 362 00000100:00100000:1.0:1788873883.286235:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2398:x1875769840219520:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873883.287892:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:64e5d878-4280-4742-8a19-a12ccf17cae7+18:2398:x1875769840219520:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 1677us (6516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873883.287910:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 362 00000100:00100000:1.0:1788873883.287976:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 363 00000100:00100000:1.0:1788873883.288005:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2398:x1875769840220032:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873883.288044:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2398:x1875769840220032:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 46us (6643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873883.288052:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 363 00000100:00080000:1.0:1788873883.289194:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873883.289201:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873883.289234:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788873883.289238:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788873883.290961:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 361 00010000:00010000:3.0:1788873883.760770:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788873884.766026:0:14953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:24:44 (1788873884) 00010000:00010000:0.0:1788873884.782790:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873885.425166:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859143040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873885.425383:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873885.425576:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143040 00000100:00100000:3.0:1788873885.425586:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143040 00000100:00100000:3.0:1788873885.425650:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788873885.425660:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859143040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873885.425705:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788873885.425773:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859143040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873885.425782:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788873885.425844:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859143040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788873885.807977:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873886.833723:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873886.958666:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859143168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788873886.958771:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859143296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788873886.958814:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873886.958838:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143168 00000100:00100000:0.0:1788873886.958850:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143168 00000100:00100000:0.0:1788873886.958981:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788873886.958995:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859143168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788873886.959032:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788873886.959102:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859143168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873886.959123:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788873886.959148:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859143168:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788873886.959354:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788873886.959575:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873886.959624:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143296 00000100:00100000:2.0:1788873886.959630:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143296 00000100:00080000:1.0:1788873886.959720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788873886.959737:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788873886.959747:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859143296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873886.959763:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788873886.959818:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859143296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873886.959826:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788873886.960842:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859143296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788873887.471383:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859143424:0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.471421:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859143680:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.471532:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859143552:0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.474294:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873887.474395:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143680 00000100:00100000:1.0:1788873887.474410:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143680 00000100:00100000:3.0:1788873887.474472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873887.474492:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788873887.474504:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859143680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873887.474575:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859143936:0@lo:400:kworker.0 00000100:00100000:3.0:1788873887.474630:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873887.474654:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859144448:0@lo:400:kworker.0 00000100:00100000:3.0:1788873887.474681:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873887.474706:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859144960:0@lo:400:kworker.0 00000100:00100000:3.0:1788873887.474729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873887.474770:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143424 00000100:00100000:3.0:1788873887.474775:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143424 00000100:00100000:3.0:1788873887.474811:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788873887.474819:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859143424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.479910:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859144192:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.479921:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873887.479985:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859144064:0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.479987:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873887.480010:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873887.480028:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859144704:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.480028:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859144576:0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.480051:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873887.480083:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859143808:0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.480107:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143552 00000100:00100000:0.0:1788873887.480112:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873887.480118:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143552 00000100:00100000:0.0:1788873887.480136:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859144320:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.480163:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873887.480170:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144192 00000100:00100000:2.0:1788873887.480172:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144192 00000100:00100000:0.0:1788873887.480181:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859144832:0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.480199:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144064 00000100:00100000:0.0:1788873887.480201:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873887.480202:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144064 00000100:00100000:2.0:1788873887.480241:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144704 00000100:00100000:2.0:1788873887.480244:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144704 00000100:00100000:2.0:1788873887.480258:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143808 00000100:00100000:2.0:1788873887.480260:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143808 00000100:00100000:2.0:1788873887.480275:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788873887.480285:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859143552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.480375:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859143552:12345-0@lo:400:kworker.0 Request processed in 90us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873887.480383:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788873887.480414:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788873887.480421:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859144192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.480421:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788873887.480427:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859144064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873887.480453:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859144192:12345-0@lo:400:kworker.0 Request processed in 34us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.480453:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859144064:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873887.480460:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788873887.480504:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788873887.480522:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788873887.480528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859144704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.480637:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859144704:12345-0@lo:400:kworker.0 Request processed in 109us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.480643:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788873887.480666:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788873887.480681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859143808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.480819:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859143808:12345-0@lo:400:kworker.0 Request processed in 46us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.480828:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788873887.480854:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144448 00000100:00100000:0.0:1788873887.480858:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144448 00000100:00100000:0.0:1788873887.480881:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144960 00000100:00100000:0.0:1788873887.480895:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144960 00000100:00100000:0.0:1788873887.480912:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144320 00000100:00100000:0.0:1788873887.480914:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144320 00000100:00100000:0.0:1788873887.480926:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144832 00000100:00100000:0.0:1788873887.480929:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144832 00000100:00100000:0.0:1788873887.480954:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788873887.480961:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859144448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481007:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859144448:12345-0@lo:400:kworker.0 Request processed in 47us (6324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.481014:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788873887.481031:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788873887.481038:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859144960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481066:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859144960:12345-0@lo:400:kworker.0 Request processed in 30us (6338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.481193:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788873887.481242:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788873887.481250:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859144320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481281:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859144320:12345-0@lo:400:kworker.0 Request processed in 33us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.481299:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788873887.481311:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788873887.481317:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859144832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481347:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859144832:12345-0@lo:400:kworker.0 Request processed in 31us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.481353:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788873887.481402:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859143808:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481415:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859144320:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481425:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859144832:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481470:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859144448:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481483:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859144960:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873887.481540:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859143552:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481693:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859144064:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481848:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859144576 00000100:00100000:0.0:1788873887.481854:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859144576 00000100:00100000:0.0:1788873887.481884:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788873887.481901:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859144576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.481957:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859144576:12345-0@lo:400:kworker.0 Request processed in 58us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.481965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788873887.481993:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859144576:0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.482065:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859143936 00000100:00100000:0.0:1788873887.482191:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859143936 00000100:00100000:0.0:1788873887.482314:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788873887.482323:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859143936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873887.482369:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859143936:12345-0@lo:400:kworker.0 Request processed in 48us (7738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.482376:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788873887.482403:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859143936:0@lo:400:kworker.0 00000100:00080000:0.0:1788873887.482461:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873887.482467:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788873887.482470:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788873887.482494:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355c00 x1875769859144704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873887.482506:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859144704:0@lo:400:kworker.0 00010000:00080000:0.0:1788873887.482523:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f354000 x1875769859144192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873887.482531:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859144192:0@lo:400:kworker.0 00000100:00100000:1.0:1788873887.484163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859143680:12345-0@lo:400:kworker.0 Request processed in 9568us (9789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873887.484183:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788873887.484369:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859143680:0@lo:400:kworker.0 00000100:00100000:3.0:1788873887.487328:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34712cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3635:x1875769859143424:12345-0@lo:400:kworker.0 Request processed in 12493us (12840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873887.487348:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788873887.487369:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859143424:0@lo:400:kworker.0 00010000:00010000:2.0:1788873887.855856:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873887.983156:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788873887.983192:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873887.983324:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873887.983324:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873887.983339:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859145216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873887.983394:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873887.983427:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145216 00000100:00100000:0.0:1788873887.983450:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145216 00000100:00100000:3.0:1788873887.983453:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145088 00000100:00100000:3.0:1788873887.983459:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145088 00000100:00100000:0.0:1788873887.983538:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788873887.983550:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859145216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788873887.983593:0:7787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788873887.983648:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859145216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873887.983656:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788873887.983690:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859145216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873887.983767:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788873887.983776:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859145088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873887.983799:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788873887.983848:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859145088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873887.983855:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788873887.984141:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873887.984698:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873887.984712:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859145344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873887.984766:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873887.984850:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145344 00000100:00100000:2.0:1788873887.984856:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145344 00000100:00100000:2.0:1788873887.984900:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788873887.984909:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859145344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873887.984924:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788873887.984982:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859145344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873887.984989:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788873887.985073:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859145344:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788873888.047639:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788873888.047652:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788873888.047814:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788873888.047823:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788873888.248157:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873888.248465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840220416 00000100:00100000:2.0:1788873888.248482:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840220416 00000100:00100000:2.0:1788873888.248583:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:2.0:1788873888.248598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+18:13185:x1875769840220416:12345-192.168.202.20@tcp:35:umount.0 00000100:00080000:0.0:1788873888.248690:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788873888.248994:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:13185:x1875769840220416:12345-192.168.202.20@tcp:35:umount.0 Request processed in 399us (855us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788873888.249005:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 66 00000100:00100000:1.0:1788873888.254842:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873888.255096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840220672 00000100:00100000:2.0:1788873888.255113:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840220672 00000100:00100000:2.0:1788873888.255270:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:2.0:1788873888.255283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+19:13185:x1875769840220672:12345-192.168.202.20@tcp:35:umount.0 00000100:00100000:2.0:1788873888.256178:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+20:13185:x1875769840220672:12345-192.168.202.20@tcp:35:umount.0 Request processed in 891us (1349us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788873888.256190:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 67 00000100:00100000:1.0:1788873888.260382:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873888.260646:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840220928 00000100:00100000:2.0:1788873888.260662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840220928 00000100:00100000:2.0:1788873888.260752:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:2.0:1788873888.260765:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3450ede850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+20:13185:x1875769840220928:12345-192.168.202.20@tcp:35:umount.0 00000100:00100000:2.0:1788873888.261412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3450ede850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64e5d878-4280-4742-8a19-a12ccf17cae7+21:13185:x1875769840220928:12345-192.168.202.20@tcp:35:umount.0 Request processed in 646us (1046us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788873888.261545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 68 00000100:00100000:1.0:1788873888.264977:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788873888.265081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840221184 00000100:00100000:3.0:1788873888.265098:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840221184 00000100:00100000:3.0:1788873888.265177:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:3.0:1788873888.265192:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+21:13185:x1875769840221184:12345-192.168.202.20@tcp:35:umount.0 00000100:00100000:3.0:1788873888.265817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+22:13185:x1875769840221184:12345-192.168.202.20@tcp:35:umount.0 Request processed in 627us (855us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788873888.265827:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 69 00000100:00100000:1.0:1788873888.269032:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873888.269164:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840221312 00000100:00100000:0.0:1788873888.269179:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840221312 00000100:00100000:0.0:1788873888.269340:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:0.0:1788873888.269353:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+13:2400:x1875769840221312:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873888.269374:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873888.269402:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f600/0x25c660afb0a9b68c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9502 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.269438:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873888.269505:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:2400:x1875769840221312:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 154us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873888.269513:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:1.0:1788873888.272794:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873888.272885:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840221440 00000100:00100000:0.0:1788873888.272899:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840221440 00000100:00100000:0.0:1788873888.272991:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:0.0:1788873888.273005:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:2399:x1875769840221440:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873888.273026:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873888.273053:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeb200/0x25c660afb0a9b5cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a94c3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.273074:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873888.273144:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:2399:x1875769840221440:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 141us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873888.273152:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:1.0:1788873888.277640:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873888.277685:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873888.277843:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840221568 00000100:00100000:0.0:1788873888.277858:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840221568 00000100:00100000:0.0:1788873888.277948:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:0.0:1788873888.277961:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:2401:x1875769840221568:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788873888.277982:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873888.278009:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475ecaa00/0x25c660afb0a9b8a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95db expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.278030:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873888.278108:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840221568:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 149us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873888.278116:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:2.0:1788873888.278628:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840221952 00000100:00100000:2.0:1788873888.278634:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840221952 00000100:00100000:2.0:1788873888.278697:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 80 00000100:00100000:2.0:1788873888.278705:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+7:2397:x1875769840221952:12345-192.168.202.20@tcp:9:umount.0 00000020:00000080:2.0:1788873888.278737:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9bc20 00000020:00010000:2.0:1788873888.278747:0:8427:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d34452a0000: total 0 00000100:00080000:2.0:1788873888.278753:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d34452a4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788873888.278812:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788873888.279001:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2397:x1875769840221952:12345-192.168.202.20@tcp:9:umount.0 Request processed in 296us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873888.279009:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 80 00000020:00010000:3.0:1788873888.279309:0:10332:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d34452a0000: total 0 00010000:00010000:3.0:1788873888.279368:0:10332:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d34452a0000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788873888.279538:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ef6192/0x25c660afb0a9c6a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99a8 expref: 4 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873888.279617:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbe320e/0x25c660afb0a9bfd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97c5 expref: 3 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873888.279636:0:10332:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d34452a0000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788873888.279649:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873888.279651:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873888.279653:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788873888.280022:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873888.284756:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873888.284858:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840222080 00000100:00100000:0.0:1788873888.284872:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840222080 00000100:00100000:0.0:1788873888.284971:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 81 00000100:00100000:0.0:1788873888.285006:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2397:x1875769840222080:12345-192.168.202.20@tcp:9:umount.0 00000020:00000080:0.0:1788873888.285050:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b9aa 00000100:00080000:0.0:1788873888.285063:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9d3344009800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788873888.285133:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788873888.285380:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+2:2397:x1875769840222080:12345-192.168.202.20@tcp:9:umount.0 Request processed in 377us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873888.285389:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 81 00010000:00010000:0.0:1788873888.285416:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788873888.285658:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788873888.293063:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873888.293179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223104 00000100:00100000:0.0:1788873888.293193:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223104 00000100:00100000:0.0:1788873888.293523:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 258 00000100:00100000:0.0:1788873888.293538:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+22:2397:x1875769840223104:12345-192.168.202.20@tcp:39:umount.0 00000020:00000080:0.0:1788873888.293591:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b5dd 00000020:00010000:0.0:1788873888.294118:0:6511:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d33438f1000: total 0 00000100:00080000:0.0:1788873888.294126:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9d33438f4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788873888.294236:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788873888.294623:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64e5d878-4280-4742-8a19-a12ccf17cae7+21:2397:x1875769840223104:12345-192.168.202.20@tcp:39:umount.0 Request processed in 1085us (1573us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788873888.294633:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 258 00000020:00010000:3.0:1788873888.299072:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d33438f1000: total 0 00010000:00010000:0.0:1788873888.302776:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d33438f1000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788873888.302999:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873888.303004:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873888.303019:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9c588 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a995b expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303046:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873888.303049:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788873888.303076:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440031600/0x25c660afb0a9bfc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97be expref: 19 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303094:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873888.303096:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788873888.303100:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93600/0x25c660afb0a9bc7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a96de expref: 18 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303114:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3460230c00) 00010000:00010000:0.0:1788873888.303116:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788873888.303120:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d348215e200/0x25c660afb0a9b925 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95f0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303140:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d33410dda00) 00010000:00010000:0.0:1788873888.303143:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788873888.303147:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9b909 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95e9 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303163:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873888.303166:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788873888.303169:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9c05d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97e8 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303181:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873888.303184:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788873888.303188:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd92800/0x25c660afb0a9beb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9778 expref: 14 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303200:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d347650cc00) 00010000:00010000:0.0:1788873888.303551:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788873888.303557:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443800/0x25c660afb0a9c34a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a98c1 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303580:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873888.303583:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873888.303587:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecae00/0x25c660afb0a9c668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9993 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303600:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d3476dc2400) 00010000:00010000:0.0:1788873888.303602:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788873888.303606:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33442b2a00/0x25c660afb0a9c692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99a1 expref: 11 pid: 8993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303698:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d33410dd100) 00010000:00010000:0.0:1788873888.303701:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788873888.303705:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d345fd93000/0x25c660afb0a9b980 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9605 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303722:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:0.0:1788873888.303725:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788873888.303728:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb400/0x25c660afb0a9c041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97e1 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303741:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d33410dd400) 00010000:00010000:0.0:1788873888.303744:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788873888.303747:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3440030600/0x25c660afb0a9bf99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a97b0 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873888.303776:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d33438f1000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788873888.303915:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873888.303918:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873888.303922:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873888.304878:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873888.305310:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223232 00000100:00100000:0.0:1788873888.305334:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223232 00000100:00100000:0.0:1788873888.305474:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 259 00000100:00100000:0.0:1788873888.305488:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+5:2397:x1875769840223232:12345-192.168.202.20@tcp:39:umount.0 00000020:00000080:0.0:1788873888.305532:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b5e4 00000100:00080000:0.0:1788873888.305554:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9d33438f4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788873888.305598:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788873888.305851:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64e5d878-4280-4742-8a19-a12ccf17cae7+3:2397:x1875769840223232:12345-192.168.202.20@tcp:39:umount.0 Request processed in 367us (980us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788873888.305861:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 259 00000100:00080000:1.0:1788873888.305990:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788873888.306645:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873888.392578:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873888.392655:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873888.392903:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223360 00000100:00100000:1.0:1788873888.392919:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223360 00000100:00100000:1.0:1788873888.393025:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223488 00000100:00100000:1.0:1788873888.393030:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223488 00000100:00100000:1.0:1788873888.393059:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 370 00000100:00100000:1.0:1788873888.393070:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2398:x1875769840223360:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873888.393174:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2398:x1875769840223360:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 106us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873888.393195:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 370 00000100:00100000:1.0:1788873888.393261:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 371 00000100:00100000:1.0:1788873888.393269:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840223488:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788873888.393301:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2398:x1875769840223488:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 33us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873888.393307:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 371 00000100:00080000:2.0:1788873888.393976:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788873888.393985:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788873888.431193:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788873888.878756:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873889.814434:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873889.814505:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873889.814549:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788873889.818840:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223744 00000100:00100000:2.0:1788873889.818863:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223744 00000100:00100000:2.0:1788873889.818988:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223616 00000100:00100000:2.0:1788873889.818992:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223616 00000100:00100000:2.0:1788873889.819011:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840223872 00000100:00100000:2.0:1788873889.819014:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840223872 00000100:00100000:2.0:1788873889.819041:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:2.0:1788873889.819054:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+12:2401:x1875769840223744:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873889.819087:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873889.819119:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfea800/0x25c660afb0a9b6e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9548 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873889.819146:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873889.819269:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+11:2401:x1875769840223744:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 217us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873889.819278:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:2.0:1788873889.819318:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:2.0:1788873889.819326:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+10:2401:x1875769840223616:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873889.819334:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873889.819346:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92c00/0x25c660afb0a9b6e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9517 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873889.819355:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873889.819374:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+9:2401:x1875769840223616:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 49us (4869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873889.819402:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:2.0:1788873889.819456:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:2.0:1788873889.819462:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+8:2401:x1875769840223872:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788873889.819470:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873889.819479:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441653600/0x25c660afb0a9b8a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a95d4 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873889.819491:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873889.819510:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+7:2401:x1875769840223872:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 48us (4960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873889.819517:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:1.0:1788873889.828350:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873889.828464:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840224128 00000100:00100000:0.0:1788873889.828479:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840224128 00000100:00100000:0.0:1788873889.828562:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 260 00000100:00100000:0.0:1788873889.828576:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+6:2397:x1875769840224128:12345-192.168.202.20@tcp:39:umount.0 00000020:00000080:0.0:1788873889.828646:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b6f5 00000020:00010000:0.0:1788873889.828660:0:8450:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d3343acb000: total 0 00000100:00080000:0.0:1788873889.828666:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9d3343ac8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788873889.828704:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1788873889.828728:0:10332:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d3343acb000: total 0 00010000:00010000:3.0:1788873889.828803:0:10332:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d3343acb000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788873889.828855:0:10332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410dd800) 00010000:00010000:3.0:1788873889.828860:0:10332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788873889.828872:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442a00/0x25c660afb0a9c6b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99af expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873889.828906:0:10332:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d3343acb000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788873889.828933:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873889.828936:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873889.828937:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873889.828963:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+3:2397:x1875769840224128:12345-192.168.202.20@tcp:39:umount.0 Request processed in 388us (631us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788873889.828974:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 260 00000100:00100000:2.0:1788873889.838434:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788873889.838637:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840224256 00000100:00100000:0.0:1788873889.838653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840224256 00000100:00100000:0.0:1788873889.838755:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 261 00000100:00100000:0.0:1788873889.838768:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+5:2397:x1875769840224256:12345-192.168.202.20@tcp:39:umount.0 00000020:00000080:0.0:1788873889.838835:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b6fc 00000100:00080000:0.0:1788873889.838855:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9d3343a8d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788873889.838909:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788873889.839134:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873889.839173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8c7e5d0-b07e-4fb6-a776-a6d6096278d7+3:2397:x1875769840224256:12345-192.168.202.20@tcp:39:umount.0 Request processed in 407us (752us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788873889.839182:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 261 00000100:00100000:3.0:1788873889.881469:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788873889.881655:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840224512 00000100:00100000:1.0:1788873889.881669:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840224512 00000100:00100000:1.0:1788873889.881749:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 395 00000100:00100000:1.0:1788873889.881762:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+7:2397:x1875769840224512:12345-192.168.202.20@tcp:251:umount.0 00000020:00000080:1.0:1788873889.881831:0:6503:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b5ba 00000020:00010000:1.0:1788873889.881842:0:6503:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d33438f5800: total 0 00000100:00080000:1.0:1788873889.881848:0:6503:0:(import.c:65:import_set_state_nolock()) ffff9d33438f7000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788873889.881973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d31a6f3e-d81f-4ffc-812e-5eb0a6f00513+3:2397:x1875769840224512:12345-192.168.202.20@tcp:251:umount.0 Request processed in 214us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873889.881983:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 395 00000020:00010000:2.0:1788873889.882244:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d33438f5800: total 0 00010000:00010000:2.0:1788873889.882450:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d33438f5800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788873889.882502:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442200/0x25c660afb0a9b693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9509 expref: 2 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873889.882529:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d33438f5800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788873889.882542:0:6500:0:(genops.c:885:class_export_put()) final put ffff9d33438f5800/d31a6f3e-d81f-4ffc-812e-5eb0a6f00513 00010000:00010000:2.0:1788873889.882562:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873889.882565:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873889.882567:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788873889.883704:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33438f5800/d31a6f3e-d81f-4ffc-812e-5eb0a6f00513 for MGS 00000020:00000080:1.0:1788873889.883779:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33438f7000 for MGS 00010000:00010000:2.0:1788873889.903606:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873890.542510:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873890.542546:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859145472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873890.542661:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873890.542719:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145472 00000100:00100000:1.0:1788873890.542730:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145472 00000100:00100000:1.0:1788873890.542813:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788873890.542827:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859145472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873890.543118:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788873890.543193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859145472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 369us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873890.543281:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859145472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873890.543285:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00010000:2.0:1788873890.928706:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788873891.349516:0:15149:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788873891.370643:0:15149:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788873891.370699:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.370714:0:15149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.370722:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.370729:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.370741:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788873891.370746:0:15149:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788873891.370770:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788873891.370774:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788873891.370779:0:15149:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788873891.370802:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d3475ce3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788873891.371064:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873891.371072:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873891.371080:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfeaa00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873891.371083:0:10332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873891.371112:0:10332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873891.371119:0:10332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873891.371125:0:10332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788873891.371127:0:10332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788873891.371129:0:10332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788873891.371157:0:10332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873891.371164:0:10332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873891.371195:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873891.371220:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfeaa00/0x25c660afb0a9b662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b669 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873891.371235:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873891.371237:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873891.371239:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873891.371259:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769859145600:0@lo:39:umount.0 00000100:00100000:3.0:1788873891.371327:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873891.371418:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145600 00000100:00100000:3.0:1788873891.371425:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145600 00000100:00100000:3.0:1788873891.371468:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788873891.371475:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875769859145600:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788873891.371501:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b1df 00000100:00080000:3.0:1788873891.371514:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9d34651c8800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788873891.371573:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1875769859145600:12345-0@lo:39:umount.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873891.371686:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788873891.371757:0:6512:0:(genops.c:885:class_export_put()) final put ffff9d34651c9000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788873891.371782:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788873891.371810:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3475ce3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788873891.371819:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769859145600:0@lo:39:umount.0 00000020:00000080:3.0:1788873891.371841:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651c9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788873891.371887:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d34651c8800 for lustre-MDT0000 00000100:00100000:2.0:1788873891.372496:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859145728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873891.372534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873891.372577:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145728 00000100:00100000:2.0:1788873891.372651:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145728 00000100:00100000:2.0:1788873891.372687:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873891.372753:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3636:x1875769859145728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788873891.372767:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873891.372790:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443000/0x25c660afb0a9b669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b662 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.372805:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873891.372835:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3636:x1875769859145728:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873891.372842:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873891.372878:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859145728:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788873891.372898:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788873891.372911:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788873891.372916:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788873891.379172:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379194:0:15149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379233:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379241:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379266:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788873891.379273:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379279:0:15149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379305:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379312:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379330:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788873891.379346:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788873891.379352:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379360:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfea400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873891.379364:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.379374:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873891.379382:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873891.379389:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788873891.379392:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788873891.379687:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873891.380802:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873891.380814:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d348215e400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873891.380818:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873891.380827:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873891.380834:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873891.380840:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788873891.380842:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788873891.380845:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788873891.380861:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873891.380868:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873891.380893:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873891.380900:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d348215e400/0x25c660afb0a9b574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b57b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873891.380929:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873891.380931:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873891.380933:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873891.380952:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859145984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873891.381024:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873891.381097:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145984 00000100:00100000:1.0:1788873891.381104:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145984 00000100:00100000:1.0:1788873891.381158:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873891.381169:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3633:x1875769859145984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788873891.381185:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788873891.381201:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeb800/0x25c660afb0a9b57b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b574 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873891.381231:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788873891.381265:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3633:x1875769859145984:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873891.381272:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873891.381306:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859145984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788873891.381662:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381669:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873891.381689:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381769:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfea400/0x25c660afb0a9b670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b677 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381782:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.381783:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.381785:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.381801:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381810:0:15149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381817:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381824:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381838:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788873891.381847:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873891.381851:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381857:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873891.381861:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.381867:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873891.381879:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873891.381885:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788873891.381887:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788873891.381889:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788873891.382483:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.382490:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873891.382507:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.382513:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475eca000/0x25c660afb0a9b8d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b8df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873891.382658:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859145856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873891.382713:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873891.383061:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.383064:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.383066:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873891.383076:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873891.383086:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859146112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873891.383114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788873891.383149:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383158:0:15149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383164:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383182:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383198:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788873891.383220:0:15149:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788873891.383225:0:15149:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788873891.383268:0:15149:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788873891.383272:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788873891.383276:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788873891.383282:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788873891.383287:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d347a759800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788873891.383293:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d334255c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788873891.383298:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3476df4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788873891.383301:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3475f36000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788873891.383308:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9d3343acb000 c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 192.168.202.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788873891.383312:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9d33438f1000 64e5d878-4280-4742-8a19-a12ccf17cae7 192.168.202.20@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1788873891.383316:0:15149:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9d34480c8000) has exports, disconnecting them 00000020:00080000:2.0:1788873891.383321:0:15149:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d347a759800), last request at 1788873887 00000020:00000080:2.0:1788873891.383328:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b4e1 00000100:00080000:2.0:1788873891.383345:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d347a75f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788873891.383390:0:15149:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d347a759800): rc 0 00000020:00000080:2.0:1788873891.383406:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d347a759800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788873891.383415:0:15149:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d334255c000), last request at 1788873887 00000020:00000080:2.0:1788873891.383418:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b3bb 00000100:00080000:2.0:1788873891.383423:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d334255f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788873891.383440:0:15149:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d334255c000): rc 0 00000020:00000080:2.0:1788873891.383442:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d334255c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788873891.383446:0:15149:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3476df4800), last request at 1788873649 00000020:00000080:2.0:1788873891.383449:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b2b8 00000100:00080000:2.0:1788873891.383452:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d3476df2000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788873891.383464:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873891.383468:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383475:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873891.383478:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383486:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873891.383492:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873891.383497:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788873891.383499:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788873891.383501:0:10331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788873891.383520:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383526:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788873891.383536:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383544:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3441653400/0x25c660afb0a9b130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b137 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873891.383564:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.383566:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.383567:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873891.383645:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859146240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873891.383674:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788873891.383774:0:15149:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3476df4800): rc 0 00000020:00000080:2.0:1788873891.383776:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3476df4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788873891.383781:0:15149:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3475f36000), last request at 1788873649 00000020:00000080:2.0:1788873891.383785:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b279 00000100:00080000:2.0:1788873891.383790:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d3463fbb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788873891.383802:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788873891.383811:0:15149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788873891.383973:0:15149:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3475f36000): rc 0 00000004:00000080:2.0:1788873891.383980:0:15149:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbcd18169fae0 00000100:00080000:2.0:1788873891.384000:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788873891.384003:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788873891.385273:0:15149:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788873891.385307:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d347a44d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788873891.385493:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788873891.385498:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788873891.385515:0:15149:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788873891.385571:0:15149:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1788873891.385744:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873891.385752:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788873891.385763:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a759800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788873891.385807:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334255c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788873891.385829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3476df4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788873891.385850:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d347a75f800 for lustre-MDT0000 00000020:00000080:3.0:1788873891.385854:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d334255f800 for lustre-MDT0000 00000020:00000080:3.0:1788873891.385858:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3476df2000 for lustre-MDT0000 00000100:00100000:3.0:1788873891.385889:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859146368:0@lo:39:umount.0 00000100:00100000:3.0:1788873891.385960:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873891.386022:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146368 00000100:00100000:3.0:1788873891.386029:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146368 00000100:00100000:3.0:1788873891.386072:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788873891.386081:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875769859146368:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788873891.386113:0:7787:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b313 00000100:00080000:3.0:1788873891.386121:0:7787:0:(import.c:65:import_set_state_nolock()) ffff9d347a5e5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788873891.386142:0:7787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788873891.386305:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3632:x1875769859146368:12345-0@lo:39:umount.0 Request processed in 223us (343us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788873891.386313:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00010000:3.0:1788873891.386337:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788873891.386365:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d347a44d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788873891.386371:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859146368:0@lo:39:umount.0 00000100:00080000:2.0:1788873891.386575:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d3480fa7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788873891.386771:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788873891.386774:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788873891.386789:0:15149:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788873891.386855:0:15149:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788873891.386867:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d347a615000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788873891.387773:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d34480c8000) has no exports 00000100:00100000:0.0:1788873891.388437:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859145856 00000100:00100000:0.0:1788873891.388447:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859145856 00000100:00100000:0.0:1788873891.388510:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146112 00000100:00100000:0.0:1788873891.388514:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146112 00000100:00100000:0.0:1788873891.388530:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146240 00000100:00100000:0.0:1788873891.388533:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146240 00000100:00100000:0.0:1788873891.388550:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788873891.388560:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+24:3634:x1875769859145856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873891.388575:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788873891.388825:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859146496:0@lo:9:umount.0 00000100:00100000:3.0:1788873891.388928:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873891.388967:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859146624:0@lo:9:umount.0 00000100:00100000:3.0:1788873891.388988:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873891.389102:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146496 00000100:00100000:3.0:1788873891.389106:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146496 00000100:00100000:3.0:1788873891.389143:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146624 00000100:00100000:3.0:1788873891.389146:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146624 00000100:00100000:3.0:1788873891.389167:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788873891.389173:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875769859146496:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788873891.389198:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b463 00000100:00080000:3.0:1788873891.389223:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d33428ee000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788873891.389268:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788873891.389413:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3632:x1875769859146496:12345-0@lo:9:umount.0 Request processed in 239us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873891.389421:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788873891.389436:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788873891.389442:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875769859146624:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788873891.389453:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b5a5 00000100:00080000:3.0:1788873891.389459:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9d334397e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788873891.389486:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788873891.389570:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3632:x1875769859146624:12345-0@lo:9:umount.0 Request processed in 128us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873891.389577:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788873891.389819:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442c00/0x25c660afb0a9b677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b670 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873891.389837:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873891.389941:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+23:3634:x1875769859145856:12345-0@lo:103:ldlm_bl.0 Request processed in 1382us (7227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873891.389950:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788873891.389972:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788873891.389979:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+22:3636:x1875769859146112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873891.390001:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873891.390012:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92e00/0x25c660afb0a9b8df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b8d8 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873891.390023:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873891.390057:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f42e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+21:3636:x1875769859146112:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (6942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873891.390063:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788873891.390076:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788873891.390082:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+20:3636:x1875769859146240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873891.390090:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873891.390100:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215f200/0x25c660afb0a9b137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b130 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873891.390110:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873891.390135:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3636:x1875769859146240:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (6461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873891.390141:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788873891.390193:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859146240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873891.390217:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859146112:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788873891.390528:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873891.390533:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788873891.390577:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3480fa7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788873891.390595:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788873891.390597:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788873891.390600:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859146496:0@lo:9:umount.0 00000100:00080000:2.0:1788873891.390611:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d347a615000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788873891.390614:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788873891.390616:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788873891.390618:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859146624:0@lo:9:umount.0 00010000:00010000:2.0:1788873891.390639:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.390651:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873891.390680:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873891.391457:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859145856:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788873891.395656:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d34480c8000) has no exports 00000020:00000080:2.0:1788873891.447766:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b18b 00000020:00000080:2.0:1788873891.447784:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3475cac000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788873891.447808:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788873891.447958:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475cac000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788873891.447987:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788873891.447998:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788873891.448002:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9d3480da4d40) has no exports 00000020:00000080:3.0:1788873891.448486:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b184 00000020:00000080:3.0:1788873891.448494:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3475c80000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788873891.448552:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788873891.448560:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788873891.448563:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3475c86000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788873891.448565:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475c86000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788873891.448570:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788873891.448891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475c80000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788873891.950662:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873892.078728:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859146752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873892.078807:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873892.079071:0:10420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146752 00000100:00100000:3.0:1788873892.079080:0:10420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146752 00000100:00100000:3.0:1788873892.079146:0:10420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788873892.079155:0:10420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859146752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873892.079193:0:10420:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788873892.079266:0:10420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859146752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873892.079272:0:10420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788873892.079343:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873892.079555:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859146752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873892.591335:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859147008:0@lo:400:kworker.0 00000100:00100000:0.0:1788873892.591427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873892.591491:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859147520:0@lo:400:kworker.0 00000100:00100000:0.0:1788873892.591514:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873892.591542:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788873892.591548:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859147136:0@lo:400:kworker.0 00000100:00100000:0.0:1788873892.591567:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873892.591587:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859147648:0@lo:400:kworker.0 00000100:00100000:0.0:1788873892.591606:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873892.591636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147520 00000100:00100000:0.0:1788873892.591645:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147520 00000100:00100000:0.0:1788873892.591683:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147136 00000100:00100000:0.0:1788873892.591687:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147136 00000100:00100000:0.0:1788873892.591699:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147648 00000100:00100000:0.0:1788873892.591702:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147648 00000100:00100000:0.0:1788873892.591729:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788873892.591739:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859147648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873892.591790:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859147648:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873892.591797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788873892.591815:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788873892.591819:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875769859147520:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788873892.591825:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788873892.591849:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875769859147520:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788873892.591854:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788873892.591865:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788873892.591869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875769859147136:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788873892.591881:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788873892.591916:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875769859147136:12345-0@lo:400:kworker.0 Request processed in 45us (347us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788873892.591923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1788873892.591960:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788873892.591976:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9d344553e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788873892.591980:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788873892.592629:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859146880:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.592678:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873892.592708:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859147392:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.592745:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873892.592771:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788873892.592777:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859147264:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.592801:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873892.592819:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859147776:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.592857:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873892.592888:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147776 00000100:00100000:2.0:1788873892.592904:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147776 00000100:00100000:2.0:1788873892.592944:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788873892.592951:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859147776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.592991:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859147776:12345-0@lo:400:kworker.0 Request processed in 41us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873892.592997:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788873892.593025:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147392 00000100:00100000:2.0:1788873892.593029:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147392 00000100:00100000:2.0:1788873892.593047:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788873892.593053:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859147392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.593081:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859147392:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873892.593087:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788873892.593099:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147264 00000100:00100000:2.0:1788873892.593102:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147264 00000100:00100000:2.0:1788873892.593114:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788873892.593117:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875769859147264:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788873892.593122:0:8993:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788873892.593143:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875769859147264:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788873892.593148:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1788873892.593177:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788873892.593180:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788873892.593183:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788873892.593189:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873892.593199:0:3634:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 210 00000100:00080000:2.0:1788873892.593235:0:3634:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3342559000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873892.593273:0:3634:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a726d80 x1875769859147904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873892.593296:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859147264:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.593311:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859147776:0@lo:400:kworker.0 00010000:00080000:2.0:1788873892.593321:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886680 x1875769859147392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873892.593330:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859147392:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.593356:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859147904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788873892.593382:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873892.593409:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147904 00000100:00100000:2.0:1788873892.593413:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147904 00000100:00100000:2.0:1788873892.593429:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788873892.593433:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1875769859147904:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788873892.593448:0:8993:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788873892.593597:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859146880 00000100:00100000:3.0:1788873892.593602:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859146880 00000100:00100000:3.0:1788873892.593634:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788873892.593641:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3634:x1875769859146880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873892.593689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7574ef44-222c-4adf-9b21-6aa184f7ffdf+19:3634:x1875769859146880:12345-0@lo:400:kworker.0 Request processed in 49us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873892.593707:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788873892.593746:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3634:1875769859146880:0@lo:400:kworker.0 00000100:00100000:1.0:1788873892.594585:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859147008 00000100:00100000:1.0:1788873892.594593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859147008 00000100:00100000:1.0:1788873892.594634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788873892.594651:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875769859147008:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788873892.594658:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788873892.594702:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1875769859147008:12345-0@lo:400:kworker.0 Request processed in 51us (3275us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788873892.594709:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1788873892.594735:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873892.594740:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788873892.621638:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1875769859147904:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 28192us (28244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788873892.621655:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788873892.621669:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873892.621675:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873892.621746:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859147904:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788873892.625627:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9d344553e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873892.625641:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:0.0:1788873892.625652:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d344553e000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873892.625704:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f355180 x1875769859148032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873892.625742:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859147136:0@lo:400:kworker.0 00010000:00080000:0.0:1788873892.625783:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355880 x1875769859147648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873892.625796:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859147648:0@lo:400:kworker.0 00000100:00100000:3.0:1788873892.626023:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769859148032:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788873892.626085:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873892.626249:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148032 00000100:00100000:1.0:1788873892.626258:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148032 00000100:00100000:1.0:1788873892.626306:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788873892.626315:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769859148032:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788873892.626333:0:6512:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788873892.626376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769859148032:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 61us (290us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788873892.626383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788873892.626463:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788873892.626469:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9d3444c85000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788873892.626473:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788873892.626478:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9d3444c85000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873892.626482:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:0.0:1788873892.626488:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d3444c85000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873892.626506:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f356300 x1875769859148160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873892.626536:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859147008:0@lo:400:kworker.0 00000100:00080000:0.0:1788873892.626553:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788873892.626557:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788873892.626560:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788873892.626563:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873892.626566:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 235 00000100:00080000:0.0:1788873892.626570:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d33435fe800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873892.626581:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f354700 x1875769859148288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873892.626591:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859147520:0@lo:400:kworker.0 00000100:00100000:2.0:1788873892.626726:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859148160:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788873892.626770:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873892.626796:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859148288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788873892.627077:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788873892.627108:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d344553e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788873892.627119:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788873892.627122:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769859148032:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788873892.627183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148160 00000100:00100000:3.0:1788873892.627187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148160 00000100:00100000:3.0:1788873892.627235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788873892.627240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859148160:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788873892.627249:0:6516:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788873892.627287:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859148160:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 46us (517us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788873892.627294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1788873892.627316:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3444c85000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873892.627319:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873892.627322:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859148160:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788873892.627456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148288 00000100:00100000:0.0:1788873892.627460:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148288 00000100:00100000:0.0:1788873892.627488:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788873892.627492:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1875769859148288:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788873892.627500:0:6511:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788873892.627530:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1875769859148288:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 37us (453us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788873892.627536:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788873892.627788:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873892.627793:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873892.627796:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859148288:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788873892.974469:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873893.102663:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873893.102688:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859148416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873893.102759:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873893.102933:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148416 00000100:00100000:0.0:1788873893.102942:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148416 00000100:00100000:0.0:1788873893.102993:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788873893.103003:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859148416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873893.103031:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788873893.103086:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859148416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873893.103107:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788873893.103263:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859148416:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788873893.998949:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788873894.128347:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788873894.128365:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788873894.128371:0:7441:0:(genops.c:885:class_export_put()) final put ffff9d3476df2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788873894.128390:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00080000:2.0:1788873894.128396:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788873894.128398:0:7441:0:(genops.c:885:class_export_put()) final put ffff9d3343a88000/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00100000:2.0:1788873894.128403:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000001:00080000:2.0:1788873894.128407:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788873894.128408:0:7441:0:(genops.c:885:class_export_put()) final put ffff9d33438f6000/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:3.0:1788873894.128530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3476df2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788873894.128599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3343a88000/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 for lustre-MDT0001 00000020:00000080:3.0:1788873894.128640:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33438f6000/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-MDT0001 00000020:00000080:3.0:1788873894.128669:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d347a5e5800 for lustre-MDT0001 00000020:00000080:3.0:1788873894.128675:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3343a8d800 for lustre-MDT0001 00000020:00000080:3.0:1788873894.128678:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33438f4000 for lustre-MDT0001 00000001:00100000:2.0:1788873894.129057:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788873894.129062:0:6490:0:(genops.c:885:class_export_put()) final put ffff9d3475f36000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788873894.129083:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00080000:2.0:1788873894.129089:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788873894.129091:0:6490:0:(genops.c:885:class_export_put()) final put ffff9d3343acb000/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 00000001:00100000:2.0:1788873894.129096:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000001:00080000:2.0:1788873894.129100:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788873894.129109:0:6490:0:(genops.c:885:class_export_put()) final put ffff9d33438f1000/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:0.0:1788873894.129276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f36000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788873894.129316:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3343acb000/c8c7e5d0-b07e-4fb6-a776-a6d6096278d7 for lustre-MDT0000 00000020:00000080:0.0:1788873894.129336:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33438f1000/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-MDT0000 00000020:00000080:0.0:1788873894.129364:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3463fbb800 for lustre-MDT0000 00000020:00000080:0.0:1788873894.129367:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3343ac8800 for lustre-MDT0000 00000020:00000080:0.0:1788873894.129369:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33438f4800 for lustre-MDT0000 00000001:00100000:0.0:1788873894.129532:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788873894.129537:0:9507:0:(genops.c:885:class_export_put()) final put ffff9d3343979000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788873894.129583:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:0.0:1788873894.129586:0:9507:0:(genops.c:885:class_export_put()) final put ffff9d34452a0000/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:3.0:1788873894.130000:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3343979000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788873894.130036:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d334397e800 for lustre-OST0001 00000020:00000080:1.0:1788873894.131488:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34452a0000/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-OST0001 00000001:00100000:2.0:1788873894.131560:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788873894.131565:0:8420:0:(genops.c:885:class_export_put()) final put ffff9d33428ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788873894.131736:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d34452a4000 for lustre-OST0001 00000001:00100000:2.0:1788873894.131738:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:2.0:1788873894.131741:0:8420:0:(genops.c:885:class_export_put()) final put ffff9d334400f800/64e5d878-4280-4742-8a19-a12ccf17cae7 00000020:00000080:1.0:1788873894.131742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33428ec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788873894.131764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334400f800/64e5d878-4280-4742-8a19-a12ccf17cae7 for lustre-OST0000 00000020:00000080:1.0:1788873894.131778:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33428ee000 for lustre-OST0000 00000020:00000080:1.0:1788873894.131782:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3344009800 for lustre-OST0000 00010000:00010000:2.0:1788873895.022503:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873896.047636:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873897.071114:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873897.201452:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859148544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873897.201528:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873897.201803:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148544 00000100:00100000:1.0:1788873897.201812:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148544 00000100:00100000:1.0:1788873897.201945:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788873897.201957:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859148544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788873897.201991:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788873897.202049:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859148544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873897.202057:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1788873897.202116:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788873897.202201:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859148544:0@lo:13:osp-pre-0-1.0 00000020:01000000:3.0:1788873897.518349:0:15149:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d334352d840 - data ffff9d33420ab360/ffff9d3343808800 00000020:01000000:3.0:1788873897.518522:0:15149:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d3480ef9420 - data ffff9d347196d0d8/ffff9d3479b5e800 00000001:00000004:3.0:1788873897.524883:0:15149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788873897.583742:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788873897.583751:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788873897.583767:0:15149:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9d347a724380 x1875769859146368/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873901 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873897.583791:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788873897.588953:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788873897.588960:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788873897.589031:0:15149:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788873897.589034:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788873897.591837:0:8787:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788873897.591854:0:8787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788873897.591871:0:8787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788873897.594232:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788873897.594240:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788873897.594260:0:15149:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788873897.594263:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788873897.599835:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788873897.599852:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788873897.599866:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788873897.600648:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b153 00000020:00000080:0.0:1788873897.600658:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3480fa3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788873897.602731:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b168 00000020:00000080:0.0:1788873897.602743:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d34651ca800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788873897.602750:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788873897.602754:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873897.602769:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788873897.602773:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9d34480c99c0) has no exports 00000004:01000000:0.0:1788873897.602944:0:15149:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788873897.602952:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b59e 00000020:00000080:0.0:1788873897.602957:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3341eae800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788873897.602961:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788873897.602964:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873897.602974:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788873897.602976:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9d33439b0000) has no exports 00000020:00000080:0.0:1788873897.602983:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b597 00000020:00000080:0.0:1788873897.602986:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d347a612000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788873897.603558:0:15149:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788873897.603563:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788873897.603568:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788873897.603575:0:15149:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788873897.603578:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788873897.603607:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873897.603615:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788873897.603620:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b45c 00000020:00000080:0.0:1788873897.603625:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d334255f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788873897.603629:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788873897.603633:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873897.603638:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788873897.603640:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9d3342960000) has no exports 00000020:00000080:0.0:1788873897.603645:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b455 00000020:00000080:0.0:1788873897.603648:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3480fa1000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788873897.604062:0:15149:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788873897.604065:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788873897.604068:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000020:00000080:1.0:1788873897.604137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480fa3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788873897.604146:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651ca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788873897.604151:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341eae800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788873897.604155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a612000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788873897.604160:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d347a615000 for lustre-OST0001-osc-MDT0000 00000004:00080000:0.0:1788873897.604160:0:15149:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788873897.604162:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788873897.604166:0:8:0:(genops.c:885:class_export_put()) final put ffff9d3341eaa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788873897.604168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341eaa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788873897.604172:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788873897.604201:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873897.604229:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788873897.604239:0:15149:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788873897.604244:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b30c 00000020:00000080:0.0:1788873897.604248:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d347a448800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788873897.604255:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788873897.604257:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334255f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788873897.604261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480fa1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788873897.604264:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3480fa7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788873897.604264:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873897.604268:0:8:0:(genops.c:885:class_export_put()) final put ffff9d334255c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788873897.604268:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1788873897.604270:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334255c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:0.0:1788873897.604270:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9d3476e28000) has no exports 00000020:01000000:1.0:1788873897.604273:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788873897.604274:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b305 00000020:00000080:0.0:1788873897.604277:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d347a448000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788873897.604299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a448800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788873897.604304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a448000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788873897.605291:0:15149:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788873897.605305:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788873897.605309:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788873897.605315:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788873897.605356:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873897.605363:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788873897.605387:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873897.605390:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788873897.605395:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3480fa5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788873897.605399:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480fa5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788873897.605404:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788873897.605407:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d347a44d000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788873897.605414:0:8:0:(genops.c:885:class_export_put()) final put ffff9d347a44c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788873897.605416:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a44c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788873897.605425:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788873897.605991:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b16f 00000020:00000080:1.0:1788873897.606002:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d34651cd800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788873897.606018:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788873897.606025:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873897.606031:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788873897.606036:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9d34480ccd40) has no exports 00000020:00000080:3.0:1788873897.606047:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651cd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788873897.606066:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873897.606071:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788873897.606073:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d34651cf800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788873897.606076:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651cf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788873897.606080:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788873897.606112:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b176 00000020:00000080:1.0:1788873897.606117:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d34651cf000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788873897.606136:0:15149:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d34473c7800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788873897.606140:0:15149:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d34473c7800 3 00000020:01000004:1.0:1788873897.606143:0:15149:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d34473c7800 from lustre-MDT0000 00000020:00000080:1.0:1788873897.606162:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873897.606166:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788873897.606168:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3480fa2800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788873897.606170:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480fa2800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788873897.606176:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788873897.606226:0:15149:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788873897.606232:0:15149:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788873897.606235:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788873897.606238:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873897.606241:0:15149:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788873897.606248:0:15149:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9d3480db1000 7574ef44-222c-4adf-9b21-6aa184f7ffdf 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788873897.606255:0:15149:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9d34584a8000) has exports, disconnecting them 00000020:00080000:1.0:1788873897.606260:0:15149:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d3480db1000), last request at 1788873629 00000020:00000080:1.0:1788873897.606276:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b114 00000020:00000080:3.0:1788873897.606277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788873897.606281:0:15149:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d3480db1000: total 1 00000100:00080000:1.0:1788873897.606284:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9d3480db6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788873897.606304:0:15149:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3480db1000): rc 0 00000020:00080000:1.0:1788873897.606308:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9d34584a8000) has no exports 00000100:00100000:1.0:1788873897.606374:0:6503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d3458876000:6503] 0 exiting: rc = 1 00000020:00010000:3.0:1788873897.606412:0:10331:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d3480db1000: total 0 00010000:00010000:3.0:1788873897.606416:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873897.606442:0:10331:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d3480db1000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788873897.606479:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215ea00/0x25c660afb0a9b615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b60e expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606494:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441652000/0x25c660afb0a9b8c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b8bc expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606506:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475eca800/0x25c660afb0a9b8b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b8ae expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606516:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215e000/0x25c660afb0a9b685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b67e expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606525:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd92600/0x25c660afb0a9b623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b61c expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606534:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9b8d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b8ca expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606546:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d348215fa00/0x25c660afb0a9b535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b52e expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606558:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93800/0x25c660afb0a9b631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b62a expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606569:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfeb400/0x25c660afb0a9b63f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b638 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606590:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93e00/0x25c660afb0a9b64d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b646 expref: 5 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606604:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441653e00/0x25c660afb0a9b210 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b209 expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606628:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441652800/0x25c660afb0a9b21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b217 expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606638:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d344cfea200/0x25c660afb0a9b65b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c660afb0a9b654 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873897.606649:0:10331:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d3480db1000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788873897.606663:0:10331:0:(genops.c:885:class_export_put()) final put ffff9d3480db1000/7574ef44-222c-4adf-9b21-6aa184f7ffdf 00010000:00010000:3.0:1788873897.606673:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873897.606675:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873897.606676:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873897.606706:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d3458877000:6505] 1 exiting: rc = 0 00000020:00000080:3.0:1788873897.606745:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480db1000/7574ef44-222c-4adf-9b21-6aa184f7ffdf for MGS 00000020:00000080:3.0:1788873897.606770:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3480db6800 for MGS 00000100:00100000:1.0:1788873897.608310:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d3458877800:6506] 2 exiting: rc = 0 00000100:00100000:3.0:1788873897.609697:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609708:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609720:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609727:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609732:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609737:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609742:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609748:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609752:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609757:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609761:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609767:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609771:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609776:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609781:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609788:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609794:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609813:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609818:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609824:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609830:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609837:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609853:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609860:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609866:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609871:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609877:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609883:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609889:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609894:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609899:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609905:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609911:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609917:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609922:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609928:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609934:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609940:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609945:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609951:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609956:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609962:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609967:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609973:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609978:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609983:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609988:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609993:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.609998:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610003:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610007:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610012:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610026:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610031:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610035:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610041:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610046:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610051:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610057:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610063:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610069:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610074:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610080:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873897.610086:0:15149:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788873897.612578:0:15149:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d334352d5a0 - data ffff9d33420a8360/ffff9d334380a000 00000020:01000000:3.0:1788873897.612703:0:15149:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d3458e683c0 - data ffff9d3471889a20/ffff9d34584bb400 00000020:00000080:3.0:1788873897.613289:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b0f8 00000020:00000080:3.0:1788873897.613300:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3442ab7000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788873897.613318:0:15149:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d34473c7800 from MGS, refs=2 00000020:01000004:3.0:1788873897.613322:0:15149:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d34473c7800 2 00000020:01000004:3.0:1788873897.613325:0:15149:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d34473c7800 from MGS 00000020:00000080:1.0:1788873897.613373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3442ab7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788873897.615117:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788873897.615133:0:15149:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788873897.615138:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d344828c000/MGS 00000020:00000080:3.0:1788873897.615143:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d344828c000/MGS for MGS 00000020:01000000:3.0:1788873897.615153:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788873897.615254:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788873897.615259:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788873897.615265:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788873897.615273:0:15149:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d3463fb9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788873897.615279:0:15149:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9d3475d84d40) has exports, disconnecting them 00000020:00080000:3.0:1788873897.615284:0:15149:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d3463fb9000), last request at 1788873630 00000020:00000080:3.0:1788873897.615290:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b1c3 00000020:00080000:3.0:1788873897.615309:0:15149:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3463fb9000): rc 0 00000020:00000080:3.0:1788873897.615332:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3463fb9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788873897.615464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3463fb9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788873897.619286:0:15149:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788873897.619295:0:15149:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788873897.619299:0:15149:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788873897.619306:0:15149:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788873897.619336:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3475ce3800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788873897.619584:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873897.619593:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788873897.619598:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d34651ce000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788873897.619601:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651ce000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788873897.619612:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788873897.619688:0:15149:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d34473c7800 1 00000020:00000080:1.0:1788873897.619694:0:15149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b0ea 00000020:00000080:1.0:1788873897.619713:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d3448288000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788873897.619722:0:15149:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788873897.619730:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3448288000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788873897.619738:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873897.619743:0:15149:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788873897.619747:0:15149:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9d34480cb380) has no exports 00000100:00080000:0.0:1788873897.711358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788873897.711366:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788873897.711371:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3444c85000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873897.711381:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 429 00000100:00100000:1.0:1788873897.711385:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859148672:0@lo:400:kworker.0 00000100:00080000:0.0:1788873897.711389:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788873897.711399:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d3444c85000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873897.711427:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f355880 x1875769859148800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788873897.711447:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875769859148672 offset 0 length 224: 4 00000100:00080000:0.0:1788873897.711454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788873897.711459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788873897.711461:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d344553e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873897.711466:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 429 00000100:00080000:0.0:1788873897.711470:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788873897.711474:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d344553e000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873897.711488:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f354700 x1875769859148928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788873897.711498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788873897.711513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788873897.711515:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873897.711518:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 429 00000100:00080000:0.0:1788873897.711521:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788873897.711525:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3342559000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873897.711538:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f356300 x1875769859149056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788873897.711606:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859149184:0@lo:400:kworker.0 00000100:00100000:1.0:1788873897.711644:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788873897.711799:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788873897.711803:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788873897.711805:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873897.711808:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 429 00000100:00080000:0.0:1788873897.711811:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788873897.711815:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d33435fe800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873897.711829:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f357100 x1875769859149312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788873897.711935:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873897.711943:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859149440:0@lo:400:kworker.0 00000100:00100000:1.0:1788873897.711976:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873897.712007:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149184 00000100:00100000:1.0:1788873897.712014:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149184 00000100:00100000:1.0:1788873897.712067:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149440 00000100:00100000:1.0:1788873897.712071:0:8993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149440 00000100:00100000:1.0:1788873897.712095:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788873897.712103:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859149184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873897.712152:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859149184:12345-0@lo:400:kworker.0 Request processed in 49us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873897.712159:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788873897.712177:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788873897.712184:0:8993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859149440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873897.712239:0:8993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859149440:12345-0@lo:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873897.712245:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:1.0:1788873897.712276:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788873897.712310:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3475efb100 x1875769859149440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873897.712439:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859149568:0@lo:400:kworker.0 00000100:00100000:0.0:1788873897.712473:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873897.712508:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149568 00000100:00100000:0.0:1788873897.712512:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149568 00000100:00100000:0.0:1788873897.712545:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788873897.712551:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859149568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873897.712582:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859149568:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873897.712733:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859149440:0@lo:400:kworker.0 00010000:00080000:1.0:1788873897.712748:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d347f355180 x1875769859149184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873897.712756:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859149184:0@lo:400:kworker.0 00000100:00100000:0.0:1788873897.712797:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788873897.712829:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859149568:0@lo:400:kworker.0 00000100:00080000:1.0:1788873897.712881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873897.714183:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859148800:0@lo:38:kworker.0 00000100:00100000:3.0:1788873897.714262:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873897.714303:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769859148928:0@lo:38:kworker.0 00000100:00100000:3.0:1788873897.714330:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873897.714352:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859149056:0@lo:38:kworker.0 00000100:00100000:3.0:1788873897.714374:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873897.714623:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148928 00000100:00100000:1.0:1788873897.714631:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148928 00000100:00100000:0.0:1788873897.714758:0:7787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859148800 00000100:00100000:0.0:1788873897.714762:0:7787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859148800 00000100:00100000:0.0:1788873897.714788:0:7787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788873897.714795:0:7787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3632:x1875769859148800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788873897.714815:0:7787:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788873897.714871:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859149312:0@lo:38:kworker.0 00000100:00100000:1.0:1788873897.714874:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149056 00000100:00100000:1.0:1788873897.714880:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149056 00000100:00100000:1.0:1788873897.714905:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788873897.714911:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859148928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788873897.714922:0:6509:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788873897.714941:0:7787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3632:x1875769859148800:12345-0@lo:38:kworker.0 Request processed in 145us (678us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788873897.714947:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859148928:12345-0@lo:38:kworker.0 Request processed in 36us (617us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788873897.714949:0:7787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788873897.714953:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788873897.714965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788873897.714969:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859149056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788873897.714977:0:6509:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788873897.715000:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859149056:12345-0@lo:38:kworker.0 Request processed in 30us (625us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788873897.715006:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788873897.717175:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873897.717245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149312 00000100:00100000:1.0:1788873897.717254:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149312 00000100:00080000:3.0:1788873897.717262:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3444c85000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873897.717271:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873897.717275:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859148800:0@lo:38:kworker.0 00000100:00080000:3.0:1788873897.717286:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d344553e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873897.717289:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873897.717291:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769859148928:0@lo:38:kworker.0 00000100:00080000:3.0:1788873897.717301:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873897.717304:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873897.717307:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859149056:0@lo:38:kworker.0 00000100:00100000:1.0:1788873897.717328:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788873897.717336:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1875769859149312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788873897.717356:0:6511:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788873897.717417:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1875769859149312:12345-0@lo:38:kworker.0 Request processed in 81us (248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788873897.717425:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1788873897.717449:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788873897.717455:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788873897.717459:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859149312:0@lo:38:kworker.0 00000020:00000080:2.0:1788873897.767041:0:15149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788873897.767053:0:15149:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788873897.767059:0:15149:0:(genops.c:885:class_export_put()) final put ffff9d34473c5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788873897.767064:0:15149:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34473c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788873897.767073:0:15149:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788873897.767183:0:15149:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d34473c0800 00000020:02000400:2.0:1788873897.767456:0:15149:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788873898.095229:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873898.224485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859149696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788873898.224584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873898.224694:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149696 00000100:00100000:0.0:1788873898.224703:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149696 00000100:00100000:0.0:1788873898.224761:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788873898.224772:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859149696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788873898.224803:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788873898.224861:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859149696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873898.224867:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788873898.224986:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859149696:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1788873898.670884:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788873899.119154:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873900.144344:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788873900.819616:0:15350:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788873900.837469:0:15350:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788873900.837529:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.837546:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.837554:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.837562:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.837584:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788873900.837589:0:15350:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788873900.837612:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788873900.837616:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788873900.837634:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788873900.837639:0:15350:0:(import.c:65:import_set_state_nolock()) ffff9d344553e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788873900.837644:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788873900.837646:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788873900.837649:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788873900.838089:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873900.838097:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.838106:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442000 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873900.838110:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.838125:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873900.838133:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873900.838140:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788873900.838142:0:10333:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788873900.838144:0:10333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788873900.838183:0:10333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.838189:0:10333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873900.838420:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.838427:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f442000/0x25c660afb0a9b646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b64d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.838438:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873900.838439:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873900.838441:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873900.838539:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859149824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873900.838607:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873900.839834:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839849:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839858:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839866:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839884:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788873900.839890:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839897:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839904:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839910:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.839935:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788873900.839942:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840069:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840078:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840085:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840103:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788873900.840109:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840116:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840123:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840129:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840146:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788873900.840149:0:15350:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788873900.840181:0:15350:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788873900.840184:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788873900.840188:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873900.840193:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788873900.840200:0:15350:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9d33435ff800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788873900.840230:0:15350:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9d3341ecc800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788873900.840235:0:15350:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9d3475d819c0) has exports, disconnecting them 00000020:00080000:1.0:1788873900.840239:0:15350:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d33435ff800), last request at 1788873897 00000020:00000080:1.0:1788873900.840246:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b4f6 00000100:00080000:1.0:1788873900.840259:0:15350:0:(import.c:65:import_set_state_nolock()) ffff9d33435f9800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788873900.840301:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788873900.840307:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840314:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfebc00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873900.840318:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840325:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873900.840333:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873900.840338:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788873900.840341:0:10333:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788873900.840343:0:10333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788873900.840372:0:10333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840378:0:10333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873900.840400:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840407:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfebc00/0x25c660afb0a9b654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b65b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840418:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788873900.840421:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840426:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92200 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873900.840429:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840434:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873900.840440:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873900.840445:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788873900.840447:0:10333:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788873900.840449:0:10333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788873900.840461:0:10333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840468:0:10333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873900.840483:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840608:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788873900.840615:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840622:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb200 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873900.840632:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840639:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873900.840646:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873900.840651:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788873900.840653:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788873900.840655:0:10331:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788873900.840670:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840676:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873900.840682:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840689:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9b8ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b8d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840698:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873900.840702:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840707:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652a00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873900.840710:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840717:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873900.840729:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873900.840735:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788873900.840737:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788873900.840738:0:10331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788873900.840750:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840755:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873900.840761:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840767:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3441652a00/0x25c660afb0a9b217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b21e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873900.840779:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873900.840781:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873900.840783:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873900.840790:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873900.840841:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd92200/0x25c660afb0a9b52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c660afb0a9b535 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873900.840861:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873900.840862:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873900.840864:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873900.840880:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859150080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873900.840940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873900.841000:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873900.841007:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859150208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873900.841028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873900.841061:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859150336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873900.841084:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873900.841101:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873900.841105:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859149952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873900.841122:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788873900.841143:0:15350:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d33435ff800): rc 0 00000020:00000080:1.0:1788873900.841146:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d33435ff800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788873900.841154:0:15350:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d3341ecc800), last request at 1788873897 00000020:00000080:1.0:1788873900.841159:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b3d0 00000100:00080000:1.0:1788873900.841165:0:15350:0:(import.c:65:import_set_state_nolock()) ffff9d3341ece000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788873900.841175:0:15350:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3341ecc800): rc 0 00000020:00000080:1.0:1788873900.841177:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3341ecc800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788873900.841184:0:15350:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbcd18164fae0 00000100:00080000:1.0:1788873900.841202:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788873900.841231:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788873900.842051:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149824 00000100:00100000:3.0:1788873900.842061:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149824 00000100:00100000:3.0:1788873900.842093:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859150080 00000100:00100000:3.0:1788873900.842096:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859150080 00000100:00100000:3.0:1788873900.842103:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859150208 00000100:00100000:3.0:1788873900.842106:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859150208 00000100:00100000:3.0:1788873900.842112:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859150336 00000100:00100000:3.0:1788873900.842115:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859150336 00000100:00100000:3.0:1788873900.842121:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859149952 00000100:00100000:3.0:1788873900.842123:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859149952 00000100:00100000:3.0:1788873900.842136:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788873900.842155:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3633:x1875769859149824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788873900.842164:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788873900 with bad export cookie 2721969332491497748 00000100:00080000:1.0:1788873900.845795:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788873900.845807:0:15350:0:(import.c:65:import_set_state_nolock()) ffff9d3444c85000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788873900.846024:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873900.846059:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788873900.846069:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875769859150080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788873900.846078:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788873900 with bad export cookie 2721969332491497748 00000100:00100000:2.0:1788873900.846199:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875769859150080:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (5259us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788873900.846230:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788873900.846257:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788873900.846262:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875769859150208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788873900.846265:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788873900 with bad export cookie 2721969332491497748 00000100:00100000:2.0:1788873900.846294:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875769859150208:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (5265us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788873900.846300:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788873900.846313:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788873900.846317:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3633:x1875769859150336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788873900.846321:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788873900 with bad export cookie 2721969332491497748 00000100:00100000:2.0:1788873900.846355:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3633:x1875769859150336:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (5271us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788873900.846361:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788873900.846373:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788873900.846397:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3633:x1875769859149952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788873900.846402:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788873900 with bad export cookie 2721969332491497748 00000100:00100000:2.0:1788873900.846427:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3633:x1875769859149952:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (5304us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788873900.846432:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788873900.847078:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788873900.847083:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788873900.847086:0:3633:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788873900.847173:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:0.0:1788873900.847288:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33435ff800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788873900.847331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ecc800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788873900.847351:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33435f9800 for lustre-MDT0001 00000020:00000080:0.0:1788873900.847356:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3341ece000 for lustre-MDT0001 00010000:00010000:0.0:1788873900.847377:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873900.850354:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3633:x1875769859149824:12345-0@lo:103:ldlm_bl.0 Request processed in 8194us (11741us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788873900.850367:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788873900.850437:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788873900.854480:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788873900.854505:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788873900.854533:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788873900.854594:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788873900.854623:0:15350:0:(import.c:65:import_set_state_nolock()) ffff9d33428ed000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788873900.854643:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788873900.854645:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1788873900.854653:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788873900.854730:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859150464:0@lo:9:umount.0 00000100:00100000:0.0:1788873900.854797:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788873900.854863:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788873900.854874:0:15350:0:(import.c:65:import_set_state_nolock()) ffff9d33438f7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788873900.854891:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859150592:0@lo:9:umount.0 00000100:00100000:0.0:1788873900.854916:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788873900.855300:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d3475d819c0) has no exports 00000100:00100000:3.0:1788873900.861265:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859150464 00000100:00100000:3.0:1788873900.861279:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859150464 00000100:00100000:3.0:1788873900.861339:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859150592 00000100:00100000:3.0:1788873900.861343:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859150592 00000100:00100000:3.0:1788873900.861371:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788873900.861381:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875769859150464:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788873900.861409:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b41d 00000100:00080000:3.0:1788873900.861430:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9d3342768000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788873900.861471:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788873900.861652:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3632:x1875769859150464:12345-0@lo:9:umount.0 Request processed in 272us (6853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873900.861661:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788873900.861677:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788873900.861683:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875769859150592:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788873900.861695:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b55f 00000100:00080000:3.0:1788873900.861700:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9d3341eac800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788873900.861721:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788873900.861796:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3632:x1875769859150592:12345-0@lo:9:umount.0 Request processed in 113us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873900.861803:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788873900.861832:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788873900.861864:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33438f7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788873900.861890:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788873900.861893:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788873900.861897:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859150592:0@lo:9:umount.0 00000100:00080000:3.0:1788873900.861913:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ed000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788873900.861922:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788873900.861924:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788873900.861927:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859150464:0@lo:9:umount.0 00000100:00080000:0.0:1788873900.863286:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788873900.863293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788873900.865157:0:3633:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788873900.865161:0:3633:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788873900.865172:0:3633:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d347f357800 x1875769859148672/t0(0) o400->MGC192.168.202.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873913 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873900.865229:0:3633:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343993800 x1875769859149824/t0(0) o103->MGC192.168.202.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873916 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873900.865240:0:3633:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343b2d880 x1875769859150080/t0(0) o103->MGC192.168.202.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873916 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873900.865249:0:3633:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343990e00 x1875769859150208/t0(0) o103->MGC192.168.202.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873916 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873900.865257:0:3633:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343990700 x1875769859150336/t0(0) o103->MGC192.168.202.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873916 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873900.865265:0:3633:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343b2df80 x1875769859149952/t0(0) o103->MGC192.168.202.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873916 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873900.865530:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3636:1875769859148672:0@lo:400:kworker.0 00000100:00080000:1.0:1788873900.866832:0:3635:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9d3480f22800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788873900.866855:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859150080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873900.866883:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3635:1875769859150208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788873900.866905:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788873900.867200:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788873900.867215:0:3633:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788873900.867216:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788873900.867222:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873900.867227:0:3633:0:(import.c:545:import_select_connection()) MGC192.168.202.120@tcp: connect to NID 0@lo last attempt 166 00000100:00080000:2.0:1788873900.867235:0:3633:0:(import.c:665:import_select_connection()) MGC192.168.202.120@tcp: import ffff9d3480f22800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873900.867282:0:3633:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a725180 x1875769859150720/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873900.867331:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859150336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873900.867339:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859149824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788873900.867353:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3633:1875769859149952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873900.867565:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769859150720:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788873900.867631:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875769859150720 offset 0 length 520: 4 00000020:00080000:1.0:1788873900.878528:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d3475d819c0) has no exports 00000020:01000000:2.0:1788873900.931578:0:15350:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d334352dc00 - data ffff9d3471a77798/ffff9d347a6a7800 00000020:01000000:2.0:1788873900.931732:0:15350:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d347a4dede0 - data ffff9d3471944870/ffff9d347a605000 00000001:00000004:2.0:1788873900.944986:0:15350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788873901.011046:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788873901.011056:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788873901.011064:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788873901.013346:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788873901.013353:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788873901.013366:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788873901.013376:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788873901.014452:0:8779:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788873901.014459:0:8779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788873901.014473:0:8779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788873901.014978:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788873901.014985:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788873901.015004:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788873901.015007:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788873901.016100:0:9976:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788873901.016106:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788873901.016116:0:9976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788873901.017668:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b23a 00000020:00000080:1.0:1788873901.017677:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d34651ca000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788873901.017891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651ca000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788873901.019888:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b24f 00000020:00000080:1.0:1788873901.019899:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d344f55d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788873901.019935:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788873901.019940:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873901.019948:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788873901.019952:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9d3475d83380) has no exports 00000004:01000000:1.0:1788873901.020123:0:15350:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788873901.020131:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b558 00000020:00000080:1.0:1788873901.020135:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d334397b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873901.020190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d344f55d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788873901.020274:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788873901.020277:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873901.020283:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788873901.020285:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9d3342963380) has no exports 00000020:00000080:1.0:1788873901.020290:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b551 00000020:00000080:1.0:1788873901.020293:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d347a44c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788873901.020365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334397b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1788873901.020941:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788873901.020968:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788873901.020972:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788873901.020977:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788873901.020980:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788873901.021276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a44c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788873901.021461:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873901.021470:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788873901.021477:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b416 00000020:00000080:1.0:1788873901.021484:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d334276a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873901.021520:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33438f7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788873901.021527:0:8:0:(genops.c:885:class_export_put()) final put ffff9d347a75c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873901.021529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a75c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788873901.021538:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788873901.021893:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788873901.021897:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873901.021901:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788873901.021904:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9d34584a99c0) has no exports 00000020:00000080:1.0:1788873901.021908:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b40f 00000020:00000080:1.0:1788873901.021912:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d33428e8000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788873901.021925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334276a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1788873901.022290:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788873901.022293:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788873901.022296:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788873901.022300:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788873901.022310:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788873901.022434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33428e8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788873901.022521:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873901.022528:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788873901.022540:0:15350:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788873901.022544:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b272 00000020:00000080:1.0:1788873901.022548:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3475f31800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873901.022742:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33428ed000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788873901.022750:0:8:0:(genops.c:885:class_export_put()) final put ffff9d3341ea8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873901.022753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ea8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788873901.022757:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788873901.022863:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788873901.022867:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873901.022871:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788873901.022873:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9d3476e2b380) has no exports 00000020:00000080:1.0:1788873901.022877:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b26b 00000020:00000080:1.0:1788873901.022880:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3444c80000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788873901.022893:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f31800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788873901.023867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3444c80000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788873901.024271:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788873901.024276:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788873901.024279:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788873901.024285:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788873901.024516:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873901.024525:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788873901.024559:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873901.024563:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788873901.024569:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3475f50000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873901.024573:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f50000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788873901.024589:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788873901.024763:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b256 00000020:00000080:0.0:1788873901.024769:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d344f558000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788873901.025026:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3444c85000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788873901.025035:0:8:0:(genops.c:885:class_export_put()) final put ffff9d3444c83000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788873901.025037:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3444c83000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788873901.025042:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788873901.025177:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788873901.025182:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873901.025188:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788873901.025192:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9d3475d80000) has no exports 00000020:00000080:0.0:1788873901.025246:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873901.025250:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788873901.025255:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b25d 00000020:00000080:0.0:1788873901.025271:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d344f559800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788873901.025279:0:15350:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d34651cb800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788873901.025283:0:15350:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d34651cb800 2 00000020:01000004:0.0:1788873901.025285:0:15350:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d34651cb800 from lustre-MDT0001 00000020:00000080:0.0:1788873901.025318:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873901.025323:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788873901.025325:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3475f53800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788873901.025327:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f53800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788873901.025334:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788873901.025366:0:15350:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788873901.025476:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788873901.025479:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873901.025483:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788873901.025536:0:15350:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9d3480e6c000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788873901.025540:0:15350:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9d3476e299c0) has exports, disconnecting them 00000020:00080000:0.0:1788873901.025544:0:15350:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9d3480e6c000), last request at 1788873649 00000020:00000080:0.0:1788873901.025547:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b2b1 00000020:00080000:0.0:1788873901.025557:0:15350:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3480e6c000): rc 0 00000020:00000080:0.0:1788873901.025560:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3480e6c000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788873901.026116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d344f558000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788873901.026122:0:8:0:(genops.c:885:class_export_put()) final put ffff9d3475ce6000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788873901.026124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475ce6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788873901.026129:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788873901.026472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d344f559800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788873901.026482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480e6c000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788873901.038258:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788873901.038267:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788873901.038272:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788873901.038291:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788873901.038410:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d344553e000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788873901.038603:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788873901.038612:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788873901.038618:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3475f57000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788873901.038621:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f57000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788873901.038631:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788873901.038835:0:15350:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d34651cb800 1 00000020:00000080:3.0:1788873901.038842:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b1ed 00000020:00000080:3.0:1788873901.038849:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3475f56800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788873901.038862:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788873901.038873:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f56800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788873901.038885:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788873901.038891:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788873901.038895:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9d34584acd40) has no exports 00010000:00010000:3.0:1788873901.168392:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788873901.193407:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873901.193432:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788873901.193438:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d34651cb000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788873901.193443:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff9d34651cb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788873901.193453:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788873901.193583:0:15350:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d34651cc800 00000020:01000000:1.0:1788873901.193618:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788873901.193623:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873901.193627:0:15350:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788873901.193632:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9d3480da0000) has no exports 00000100:00100000:0.0:1788873901.194354:0:8993:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9d347a4f9200:8993] 4 exiting: rc = 0 00000100:00100000:0.0:1788873901.194470:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d345882c400:6512] 2 exiting: rc = 0 00000100:00100000:1.0:1788873901.197314:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d345882d800:6511] 1 exiting: rc = 0 00000100:00100000:1.0:1788873901.198399:0:8450:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d334253da00:8450] 3 exiting: rc = 0 00000100:00100000:3.0:1788873901.201604:0:6509:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d345882c200:6509] 0 exiting: rc = 1 00000100:00100000:0.0:1788873901.202072:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202081:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202088:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202096:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202101:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202107:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202112:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202118:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202123:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202128:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202150:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202155:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202161:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202166:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202171:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202177:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202182:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202188:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202193:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202231:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202239:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202244:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202249:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202254:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202258:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202263:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202269:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202275:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202280:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202285:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202290:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202295:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202300:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202305:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202311:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202316:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202321:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202327:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202333:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202338:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202343:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202348:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202354:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202359:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202364:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202377:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202382:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202387:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202392:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202398:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202403:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202409:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202415:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202421:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202426:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202431:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202437:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202442:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202448:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202452:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202458:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202463:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.202479:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873901.209172:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d34478b7600:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1788873901.209469:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d34478b7c00:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1788873901.209555:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209564:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209571:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209578:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209584:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209589:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209595:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209600:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209606:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209611:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209617:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209623:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209628:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209638:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209643:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209649:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209654:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209659:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209665:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209670:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209687:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209693:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209698:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209703:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209708:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209713:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209722:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209727:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209732:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209737:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209743:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209748:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209753:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209758:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209763:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209768:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209773:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209777:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209781:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209786:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209791:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209796:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209801:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209805:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209823:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209829:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209834:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209839:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209844:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209849:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209854:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209860:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209867:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209873:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209878:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209899:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209905:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209910:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209916:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209921:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209926:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209932:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.209937:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210398:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d345fe93800:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1788873901.210623:0:7787:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9d347a452600:7787] 2 exiting: rc = 0 00000100:00100000:1.0:1788873901.210752:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d34478b6200:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1788873901.210842:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210850:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210858:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210870:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210876:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210882:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210945:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210953:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210959:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210970:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210975:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210981:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.210986:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211006:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211014:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211024:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211032:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211038:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211043:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211048:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211055:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211061:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211066:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211072:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211079:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211104:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211119:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211125:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211132:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211140:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211148:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211157:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211170:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211177:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211183:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211190:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211335:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211366:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211374:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211379:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211385:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211393:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211399:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211404:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211409:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211415:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211420:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211426:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211432:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211451:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211458:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211463:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211469:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211475:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211481:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211492:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211499:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211505:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211511:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211517:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211523:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211538:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211544:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.211556:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231173:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d34505e2e00:6518] 1 exiting: rc = 0 00000100:00100000:2.0:1788873901.231500:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d3480de9e00:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1788873901.231598:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231605:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231609:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231614:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231619:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231624:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231628:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231638:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231643:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231647:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231652:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231657:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231662:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231667:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231685:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231690:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231695:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231700:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231705:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231710:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231715:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231721:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231726:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231731:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231736:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231741:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231746:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231750:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231754:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231759:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231764:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231769:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231774:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231780:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231785:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231790:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231795:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231800:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231806:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231820:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231826:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231831:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231836:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231842:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231846:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231850:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231854:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231859:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231864:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231877:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231881:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231885:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231896:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231900:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231904:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231907:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231910:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231913:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231916:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231919:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231922:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231925:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.231928:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.232196:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d345845bc00:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1788873901.232569:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d3480ee5400:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1788873901.232641:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232645:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232649:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232652:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232656:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232659:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232662:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232665:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232668:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232671:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232676:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232681:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232686:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232701:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232706:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232710:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232716:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232720:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232725:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232730:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232736:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232741:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232746:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232751:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232756:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232761:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232766:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232771:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232776:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232781:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232785:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232790:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232795:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232800:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232804:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232823:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232830:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232835:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232844:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232849:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232854:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232858:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232863:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232868:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232872:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232877:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232882:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232899:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232912:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232916:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232920:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232924:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232928:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232932:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232936:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232941:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232945:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232949:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232954:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232958:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232963:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232967:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232971:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.232976:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788873901.233676:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d345845a400:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1788873901.233867:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d345845a600:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1788873901.234038:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234044:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234050:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234054:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234059:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234065:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234070:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234075:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234079:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234084:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234090:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234095:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234101:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234105:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234111:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234116:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234121:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234126:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234131:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234147:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234151:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234156:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234162:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234167:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234171:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234177:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234182:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234186:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234192:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234196:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234525:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234533:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234538:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234543:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234549:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234555:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234560:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234566:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234571:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234576:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234581:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234586:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234591:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234601:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234606:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234612:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234618:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234622:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234628:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234638:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234643:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234648:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234662:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234667:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234672:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234677:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234682:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234687:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234692:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234697:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234702:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.234708:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873901.236747:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d3445f00e00:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1788873901.237349:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d3480ee5800:6525] 2 exiting: rc = 0 00000100:00100000:2.0:1788873901.237729:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d3445f00c00:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1788873901.237862:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237869:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237875:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237881:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237887:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237902:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237908:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237912:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237918:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237923:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237927:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237932:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237938:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237944:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237950:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237973:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237980:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237985:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237992:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.237997:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238002:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238008:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238014:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238020:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238035:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238041:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238046:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238052:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238057:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238063:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238069:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238074:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238080:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238086:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238092:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238098:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238103:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238108:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238114:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238133:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238140:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238145:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238151:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238157:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238163:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238169:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238175:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238181:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238187:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238193:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238404:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238415:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238421:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238427:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238433:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238439:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238444:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238450:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238455:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238473:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238479:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238485:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873901.238490:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788873901.243449:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788873901.243463:0:15350:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788873901.243468:0:15350:0:(genops.c:885:class_export_put()) final put ffff9d3480f23800/MDS_uuid 00000020:00000080:3.0:1788873901.243473:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480f23800/MDS_uuid for MDS 00000020:01000000:3.0:1788873901.243478:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788873901.243640:0:15350:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788873902.190304:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788873902.831400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873902.831407:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873902.831410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873902.831414:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788873902.831418:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873902.831426:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1788873902.831433:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788873902.831439:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3342559000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873902.831479:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343991180 x1875769859150848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873902.831525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873902.831529:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788873902.831531:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873902.831534:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1788873902.831536:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788873902.831541:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d33435fe800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873902.831553:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343991c00 x1875769859151104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873902.831849:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859150976:0@lo:400:kworker.0 00000400:00000100:0.0:1788873902.831912:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859150976 offset 0 length 224: 4 00000100:00100000:0.0:1788873902.831970:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788873902.831977:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859151232:0@lo:400:kworker.0 00000400:00000100:0.0:1788873902.831995:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859151232 offset 0 length 224: 4 00000100:00100000:1.0:1788873902.833141:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859150848:0@lo:38:kworker.0 00000400:00000100:1.0:1788873902.833172:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859150848 offset 0 length 520: 4 00000100:00100000:1.0:1788873902.833194:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859151104:0@lo:38:kworker.0 00000400:00000100:1.0:1788873902.833233:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859151104 offset 0 length 520: 4 00010000:00010000:2.0:1788873903.215426:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788873904.161621:0:15551:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788873904.176198:0:15551:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788873904.176310:0:15551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873904.176325:0:15551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873904.176332:0:15551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873904.176340:0:15551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873904.176364:0:15551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788873904.176379:0:15551:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788873904.176406:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788873904.176419:0:15551:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343991180 x1875769859150848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873904.176432:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788873904.176449:0:15551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788873904.176461:0:15551:0:(import.c:65:import_set_state_nolock()) ffff9d3342559000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788873904.176467:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788873904.176470:0:15551:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343991180 x1875769859150848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873922 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873904.176478:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788873904.176482:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1788873904.176574:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859150848:0@lo:38:kworker.0 00010000:00010000:0.0:1788873904.176975:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873904.176982:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873904.176988:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873904.176991:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873904.176999:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873904.177021:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873904.177024:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788873904.177026:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788873904.177028:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788873904.177040:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:0.0:1788873904.177042:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873904.177046:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f443400/0x25c660afb0a9b62a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b631 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873904.177056:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873904.177058:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873904.177059:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788873904.177852:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788873904.177870:0:15551:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343992a00 x1875769859150976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873918 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873904.177890:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788873904.177895:0:15551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788873904.177917:0:15551:0:(import.c:65:import_set_state_nolock()) ffff9d3341eab800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788873904.177922:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859150976:0@lo:400:kworker.0 00000100:00100000:1.0:1788873904.178464:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1875769859151360:0@lo:39:umount.0 00000400:00000100:1.0:1788873904.178516:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859151360 offset 0 length 224: 4 00010000:00010000:1.0:1788873904.238363:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873905.262717:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788873905.838460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788873905.838474:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873905.838478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788873905.838797:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788873905.839070:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859151488:0@lo:400:kworker.0 00000400:00000100:2.0:1788873905.839138:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859151488 offset 0 length 224: 4 00010000:00010000:2.0:1788873906.286430:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788873906.929543:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788873906.929554:0:9507:0:(genops.c:885:class_export_put()) final put ffff9d3341eae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788873906.929689:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341eae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788873906.929840:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3341eac800 for lustre-OST0001 00000001:00100000:2.0:1788873906.931936:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788873906.931946:0:8420:0:(genops.c:885:class_export_put()) final put ffff9d334276d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788873906.932087:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334276d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788873906.932135:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3342768000 for lustre-OST0000 00010000:00010000:2.0:1788873907.311352:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788873907.886431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788873907.886441:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873907.886445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788873907.886448:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788873907.891856:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859151616:0@lo:400:kworker.0 00000400:00000100:3.0:1788873907.891924:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859151616 offset 0 length 224: 4 00010000:00010000:0.0:1788873908.336152:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873909.358379:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873910.318594:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873900/real 1788873900] req@ffff9d347a725180 x1875769859150720/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788873910 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873910.318627:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347a725180 x1875769859150720/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788873910 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788873910.318647:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873910.318673:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788873910.318677:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769859150720:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788873910.318810:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788873910.318816:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788873910.318819:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873910.318824:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.120@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1788873910.318829:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788873910.318836:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.120@tcp: import ffff9d3480f22800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873910.318877:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a724000 x1875769859151744/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873910.318908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788873910.318914:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788873910.319019:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873910.319032:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859151872:0@lo:400:kworker.0 00000400:00000100:3.0:1788873910.319079:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859151872 offset 0 length 224: 4 00000100:00100000:1.0:1788873910.319829:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769859151744:0@lo:250:kworker.0 00000400:00000100:1.0:1788873910.319864:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875769859151744 offset 0 length 520: 4 00010000:00010000:3.0:1788873910.382947:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873911.406462:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873912.430440:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873913.454438:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873914.414327:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873904/real 1788873904] req@ffff9d3343991500 x1875769859151360/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788873914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873914.414359:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343991500 x1875769859151360/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788873914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788873914.414379:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3341eab800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788873914.414459:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1875769859151360:0@lo:39:umount.0 00000100:00080000:3.0:1788873914.414521:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788873914.414526:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788873914.414531:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788873914.416459:0:15551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416477:0:15551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416486:0:15551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416511:0:15551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416601:0:15551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788873914.416609:0:15551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416616:0:15551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416623:0:15551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873914.416630:0:15551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416657:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788873914.416674:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416700:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873914.416705:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416714:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873914.416721:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873914.416727:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788873914.416736:0:10333:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788873914.416748:0:10333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:1.0:1788873914.416751:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416758:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f442400/0x25c660afb0a9b638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b63f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416782:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873914.416786:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416791:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873914.416794:0:10333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416800:0:10333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873914.416823:0:10333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873914.416828:0:10333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788873914.416830:0:10333:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788873914.416835:0:10333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:1.0:1788873914.416838:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873914.416844:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873914.416846:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873914.416848:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873914.419227:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873914.419264:0:15551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788873914.419277:0:15551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3441652e00/0x25c660afb0a9b8bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b8c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873914.419297:0:15551:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788873914.419306:0:15551:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788873914.419310:0:15551:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788873914.419344:0:15551:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788873914.419348:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788873914.419357:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788873914.419363:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788873914.419367:0:15551:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9d347a794d40) has no exports 00000020:00080000:3.0:1788873914.419389:0:15551:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9d347a794d40) has no exports 00000020:01000000:3.0:1788873914.423573:0:15551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d34452288a0 - data ffff9d3471b166c0/ffff9d3343926400 00000020:01000000:3.0:1788873914.424366:0:15551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d3445228480 - data ffff9d347189caf8/ffff9d347bf9e000 00100000:10000000:1.0:1788873914.451721:0:15551:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788873914.474048:0:15551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b38a 00000020:00000080:0.0:1788873914.474059:0:15551:0:(genops.c:885:class_export_put()) final put ffff9d3341ecf800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788873914.474085:0:15551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3476df3800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788873914.474089:0:15551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3476df3800 2 00000020:01000004:0.0:1788873914.474093:0:15551:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3476df3800 from lustre-OST0000 00000020:00000080:0.0:1788873914.474123:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873914.474132:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788873914.474136:0:15551:0:(genops.c:885:class_export_put()) final put ffff9d3341ecb000/lustre-OST0000_UUID 00000020:00000080:0.0:1788873914.474149:0:15551:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ecb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788873914.474155:0:15551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788873914.474249:0:15551:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788873914.474254:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788873914.474258:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873914.474263:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788873914.474270:0:15551:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d3342558800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788873914.474288:0:15551:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9d3476e2cd40) has exports, disconnecting them 00000020:00080000:0.0:1788873914.474295:0:15551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d3342558800), last request at 1788873673 00000020:00000080:0.0:1788873914.474300:0:15551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b3b4 00000020:00080000:0.0:1788873914.474310:0:15551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3342558800): rc 0 00000020:00000080:0.0:1788873914.474315:0:15551:0:(genops.c:885:class_export_put()) final put ffff9d3342558800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788873914.475176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ecf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788873914.475197:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3342558800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788873914.475241:0:15551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788873914.475246:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788873914.475250:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788873914.475255:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788873914.475412:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788873914.475418:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788873914.475423:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788873914.475427:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788873914.475430:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788873914.475435:0:15551:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9d3341ea9000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788873914.475440:0:15551:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9d34584ab380) has exports, disconnecting them 00000020:00080000:2.0:1788873914.475445:0:15551:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9d3341ea9000), last request at 1788873673 00000020:00000080:2.0:1788873914.475448:0:15551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b3c9 00000020:00080000:2.0:1788873914.475461:0:15551:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3341ea9000): rc 0 00000020:00000080:2.0:1788873914.475466:0:15551:0:(genops.c:885:class_export_put()) final put ffff9d3341ea9000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788873914.476303:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3342559000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788873914.476314:0:36:0:(genops.c:885:class_export_put()) final put ffff9d347a44b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788873914.476328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a44b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788873914.476340:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788873914.476413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ea9000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788873914.477492:0:15551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788873914.477497:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788873914.477500:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788873914.477504:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788873914.477662:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788873914.477671:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788873914.477678:0:15551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3476df3800 1 00000020:00000080:2.0:1788873914.477694:0:15551:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b352 00000020:00000080:2.0:1788873914.477703:0:15551:0:(genops.c:885:class_export_put()) final put ffff9d347a613800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788873914.477709:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788873914.477714:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788873914.477729:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788873914.477733:0:15551:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9d347a790000) has no exports 00000020:00000080:2.0:1788873914.482872:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3341eab800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788873914.482887:0:36:0:(genops.c:885:class_export_put()) final put ffff9d3341ea9800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788873914.482891:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ea9800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788873914.482898:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788873914.482960:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a613800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:0.0:1788873914.646065:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788873914.646506:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788873914.646516:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788873914.646522:0:15551:0:(genops.c:885:class_export_put()) final put ffff9d3475f56000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788873914.646527:0:15551:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3475f56000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788873914.646538:0:15551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788873914.646661:0:15551:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d3475f51800 00000020:02000400:2.0:1788873914.646716:0:15551:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1788873915.631546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873915.631557:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873915.631561:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873915.631564:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788873915.631640:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873915.631659:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859152000:0@lo:400:kworker.0 00000400:00000100:3.0:1788873915.631722:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859152000 offset 0 length 224: 4 00010000:00010000:2.0:1788873915.700007:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873916.718373:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873917.744421:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788873918.080452:0:15753:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788873918.095829:0:15753:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788873918.095933:0:15753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873918.095950:0:15753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873918.095957:0:15753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873918.095964:0:15753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873918.096000:0:15753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788873918.096006:0:15753:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788873918.096050:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788873918.096065:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343991c00 x1875769859151104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.096081:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788873918.096086:0:15753:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788873918.096093:0:15753:0:(import.c:65:import_set_state_nolock()) ffff9d33435fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788873918.096098:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788873918.096101:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343991c00 x1875769859151104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873922 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.096107:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788873918.096110:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:0.0:1788873918.096256:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873918.096265:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873918.096275:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfebe00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873918.096279:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873918.096300:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873918.096376:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873918.096385:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788873918.096396:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788873918.096398:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788873918.096414:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:0.0:1788873918.096419:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873918.096427:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfebe00/0x25c660afb0a9b60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b615 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873918.096441:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873918.096443:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873918.096445:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873918.096478:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859151104:0@lo:38:kworker.0 00000100:00080000:2.0:1788873918.097342:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788873918.097355:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343990a80 x1875769859151232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873918 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.097380:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d347f354700 x1875769859151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.097388:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d347f355880 x1875769859151616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873923 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.097403:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d347a724a80 x1875769859151872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873926 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.097410:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343990380 x1875769859152000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873931 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873918.097417:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788873918.097421:0:15753:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788873918.097442:0:15753:0:(import.c:65:import_set_state_nolock()) ffff9d33435f8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788873918.097490:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859151872:0@lo:400:kworker.0 00000100:00100000:2.0:1788873918.097501:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859151616:0@lo:400:kworker.0 00000100:00100000:0.0:1788873918.097513:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859152000:0@lo:400:kworker.0 00000100:00100000:0.0:1788873918.097528:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859151488:0@lo:400:kworker.0 00000100:00100000:0.0:1788873918.097539:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1875769859151232:0@lo:400:kworker.0 00000100:00100000:0.0:1788873918.097579:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3632:1875769859152128:0@lo:39:umount.0 00000400:00000100:0.0:1788873918.097631:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875769859152128 offset 0 length 224: 4 00010000:00010000:0.0:1788873918.766524:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873919.790501:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788873920.760077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788873920.760089:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788873920.814802:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873921.840868:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873922.862865:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873923.886532:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873924.913997:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873925.294808:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873910/real 1788873910] req@ffff9d347a724000 x1875769859151744/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788873925 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873925.294841:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347a724000 x1875769859151744/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788873925 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873925.294862:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788873925.294889:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788873925.294892:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769859151744:0@lo:250:kworker.0 00000100:00080000:3.0:1788873925.295086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873925.295090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788873925.295092:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873925.295096:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.120@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788873925.295100:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788873925.295106:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.120@tcp: import ffff9d3480f22800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873925.295134:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343993100 x1875769859152256/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873925.295299:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769859152256:0@lo:250:kworker.0 00000400:00000100:2.0:1788873925.295342:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875769859152256 offset 0 length 520: 4 00010000:00010000:0.0:1788873925.934543:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873926.958991:0:10333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873927.983897:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873928.367337:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873918/real 1788873918] req@ffff9d347a726680 x1875769859152128/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788873928 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873928.367376:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347a726680 x1875769859152128/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788873928 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873928.367401:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33435f8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788873928.367428:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3632:1875769859152128:0@lo:39:umount.0 00000100:00080000:0.0:1788873928.367802:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788873928.367808:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788873928.367815:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788873928.368978:0:15753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369004:0:15753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369011:0:15753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369017:0:15753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369043:0:15753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788873928.369049:0:15753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369055:0:15753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369060:0:15753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369065:0:15753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873928.369076:0:15753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788873928.369080:0:15753:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788873928.369104:0:15753:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788873928.369108:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788873928.369111:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873928.369117:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788873928.369130:0:15753:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9d3342964d40) has no exports 00000020:00080000:0.0:1788873928.369151:0:15753:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9d3342964d40) has no exports 00010000:00010000:2.0:1788873928.369359:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788873928.369367:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369375:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d344cfeba00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873928.369378:0:10332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369394:0:10332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873928.369401:0:10332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873928.369407:0:10332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788873928.369409:0:10332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788873928.369411:0:10332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788873928.369424:0:10332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:2.0:1788873928.369428:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369435:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfeba00/0x25c660afb0a9b61c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b623 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369449:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788873928.369453:0:10332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369458:0:10332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93c00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:2.0:1788873928.369461:0:10332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369467:0:10332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873928.369472:0:10332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873928.369487:0:10332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788873928.369489:0:10332:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788873928.369491:0:10332:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788873928.369497:0:10332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:2.0:1788873928.369500:0:10332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369506:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d345fd93c00/0x25c660afb0a9b8ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b8b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.369519:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873928.369521:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873928.369523:0:10332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873928.370756:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788873928.374541:0:15753:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d33426b73c0 - data ffff9d33420b6288/ffff9d347f3bd000 00000020:01000000:0.0:1788873928.375171:0:15753:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d34452283c0 - data ffff9d3471b1c510/ffff9d347a6d5800 00100000:10000000:2.0:1788873928.384925:0:15753:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788873928.395307:0:15753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b4b0 00000020:00000080:2.0:1788873928.395319:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d347a75b800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788873928.395336:0:15753:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3341ecd800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788873928.395340:0:15753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3341ecd800 2 00000020:01000004:2.0:1788873928.395343:0:15753:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3341ecd800 from lustre-OST0001 00000020:00000080:2.0:1788873928.395366:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788873928.395376:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788873928.395378:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d347a75f000/lustre-OST0001_UUID 00000020:00000080:2.0:1788873928.395382:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a75f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788873928.395388:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788873928.395517:0:15753:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7574ef44-222c-4adf-9b21-6aa184f7ffdf->MGS 00010000:00010000:2.0:1788873928.395532:0:15753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3441652600/0x25c660afb0a9b209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873928.395544:0:15753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3441652600/0x25c660afb0a9b209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873928.395568:0:15753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788873928.395571:0:15753:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788873928.395574:0:15753:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788873928.395592:0:15753:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:2.0:1788873928.395596:0:15753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3441652600/0x25c660afb0a9b209 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b210 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873928.395611:0:15753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788873928.395618:0:15753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873928.395623:0:15753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788873928.395626:0:15753:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788873928.395627:0:15753:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788873928.395639:0:15753:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3480f22800 00010000:00010000:2.0:1788873928.395642:0:15753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d344cfeac00/0x25c660afb0a9b67e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c660afb0a9b685 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788873928.395657:0:15753:0:(import.c:65:import_set_state_nolock()) ffff9d3480f22800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788873928.395661:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788873928.395663:0:15753:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788873928.395665:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788873928.395669:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788873928.395678:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3343993100 x1875769859152256/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788873945 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788873928.395692:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788873928.395695:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788873928.395721:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7574ef44-222c-4adf-9b21-6aa184f7ffdf:3632:1875769859152256:0@lo:250:kworker.0 10000000:01000000:2.0:1788873928.395747:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788873928.395752:0:15753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b106 00000020:00000080:2.0:1788873928.395756:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d3480f25800/7574ef44-222c-4adf-9b21-6aa184f7ffdf 00000020:01000000:2.0:1788873928.395762:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.120@tcp (flags='') 00000020:00000080:2.0:1788873928.395765:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788873928.395769:0:15753:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788873928.395773:0:15753:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9d3480da19c0) has no exports 10000000:01000000:2.0:1788873928.395804:0:6508:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788873928.395871:0:15753:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.120@tcp: client import never connected 00000100:00080000:2.0:1788873928.395873:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788873928.395875:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788873928.395877:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788873928.395879:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788873928.395910:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788873928.395913:0:15753:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.120@tcp (uuid 7574ef44-222c-4adf-9b21-6aa184f7ffdf) 00000020:01000000:2.0:1788873928.395918:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788873928.395921:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788873928.395924:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788873928.395928:0:15753:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d33435fe000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788873928.395933:0:15753:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9d347a7919c0) has exports, disconnecting them 00000020:00080000:2.0:1788873928.395937:0:15753:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d33435fe000), last request at 1788873698 00000020:00000080:2.0:1788873928.395941:0:15753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b4da 00000020:00080000:2.0:1788873928.395949:0:15753:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d33435fe000): rc 0 00000020:00000080:2.0:1788873928.395952:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d33435fe000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788873928.396729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a75b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788873928.396742:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480f25800/7574ef44-222c-4adf-9b21-6aa184f7ffdf for MGC192.168.202.120@tcp 00000020:00000080:1.0:1788873928.396747:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d3480f22800 for MGC192.168.202.120@tcp 00000020:00000080:1.0:1788873928.396754:0:36:0:(genops.c:885:class_export_put()) final put ffff9d3480f27000/7574ef44-222c-4adf-9b21-6aa184f7ffdf 00000020:00000080:1.0:1788873928.396757:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3480f27000/7574ef44-222c-4adf-9b21-6aa184f7ffdf for MGC192.168.202.120@tcp 00000020:01000000:1.0:1788873928.396760:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.120@tcp (7574ef44-222c-4adf-9b21-6aa184f7ffdf) 00000020:00000080:1.0:1788873928.397004:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33435fe000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788873928.412387:0:15753:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788873928.412396:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788873928.412401:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788873928.412412:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788873928.412474:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33435fe800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788873928.412615:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788873928.412624:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788873928.412630:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d3342b93000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788873928.412633:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3342b93000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788873928.412642:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788873928.412701:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788873928.412704:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788873928.412708:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788873928.412715:0:15753:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9d334276c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788873928.412721:0:15753:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9d33436cb380) has exports, disconnecting them 00000020:00080000:0.0:1788873928.412725:0:15753:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9d334276c000), last request at 1788873698 00000020:00000080:0.0:1788873928.412733:0:15753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b4ef 00000020:00080000:0.0:1788873928.412746:0:15753:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d334276c000): rc 0 00000020:00000080:0.0:1788873928.412750:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d334276c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788873928.412907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d334276c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788873928.468584:0:15753:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788873928.468595:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788873928.468600:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788873928.468608:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788873928.468724:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788873928.468924:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d33435f8800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788873928.468940:0:10333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788873928.480366:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788873928.480650:0:10332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:1.0:1788873928.480727:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:1.0:1788873928.480936:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d345fef4800:6495] 1 exiting: rc = 0 00000100:00100000:2.0:1788873928.480939:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d345fef4a00:6494] 0 exiting: rc = 1 00000100:00100000:0.0:1788873928.482878:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483381:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d345fef4400:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1788873928.483422:0:9516:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d3342b37800:9516] 3 exiting: rc = 0 00000100:00100000:0.0:1788873928.483462:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d344651ba00:6497] 1 exiting: rc = 0 00000100:00100000:2.0:1788873928.483501:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d345886a600:6498] 2 exiting: rc = 0 00000100:00100000:1.0:1788873928.483542:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483559:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483567:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483573:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483579:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483584:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483590:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483595:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483601:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483607:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483612:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483618:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483624:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483631:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483638:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483644:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483649:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483656:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483662:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483668:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483674:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483680:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483686:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483691:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483697:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483702:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483708:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483713:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483718:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483724:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483738:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483744:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483749:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483754:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483760:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483766:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483771:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483776:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483782:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483787:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483792:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483798:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483803:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483808:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483813:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483818:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483823:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483829:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483834:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483839:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483844:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483849:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483854:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483859:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483863:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483868:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483873:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483878:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483884:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483889:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483894:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483900:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483905:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.483911:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788873928.487483:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788873928.487508:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788873928.487514:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d33435fc800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788873928.487518:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff9d33435fc800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788873928.487525:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788873928.487639:0:15753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3341ecd800 1 00000020:00000080:1.0:1788873928.487646:0:15753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c660afb0a9b47f 00000020:00000080:1.0:1788873928.487652:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d347a79c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788873928.487677:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788873928.487681:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788873928.487686:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788873928.487691:0:15753:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9d347a793380) has no exports 00000020:00000080:0.0:1788873928.488157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a79c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788873928.523585:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788873928.523599:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788873928.523606:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d3341ec9000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788873928.523611:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3341ec9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788873928.523617:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788873928.525622:0:15753:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d3341ec8800 00000020:01000000:3.0:1788873928.525650:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788873928.525655:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788873928.525660:0:15753:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788873928.525676:0:15753:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9d3480da3380) has no exports 00000020:00000080:3.0:1788873928.525700:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788873928.525707:0:15753:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788873928.525712:0:15753:0:(genops.c:885:class_export_put()) final put ffff9d347a612800/OSS_uuid 00000020:00000080:3.0:1788873928.525715:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff9d347a612800/OSS_uuid for OSS 00000020:01000000:3.0:1788873928.525721:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788873928.525821:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d347a4fda00:8424] 0 exiting: rc = 1 00000100:00100000:2.0:1788873928.526503:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d347a4fe400:8427] 2 exiting: rc = 0 00000100:00100000:2.0:1788873928.526568:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d347a4fc600:8425] 1 exiting: rc = 0 00000100:00080000:0.0:1788873928.526666:0:6507:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788873928.526800:0:8789:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d334253b600:8789] 3 exiting: rc = 0 00000100:00100000:3.0:1788873928.527096:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527105:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527111:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527121:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527127:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527132:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527138:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527143:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527148:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527155:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527160:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527166:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527172:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527177:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527183:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527188:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527200:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527234:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527246:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527251:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527256:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527262:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527267:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527272:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527277:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527282:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527287:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527292:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527297:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527302:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527307:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527312:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527317:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527322:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527327:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527332:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527336:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527562:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527571:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527576:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527581:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527585:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527590:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527595:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527600:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527606:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527611:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527616:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527620:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527626:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527630:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527636:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527641:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527652:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527658:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527663:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527668:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527673:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527678:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527683:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527687:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527692:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527698:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.527708:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.529409:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d347a523a00:8428] 0 exiting: rc = 1 00000100:00100000:2.0:1788873928.529599:0:10420:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9d3343aa6c00:10420] 2 exiting: rc = 0 00000100:00100000:1.0:1788873928.529711:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d347a4fe000:8429] 1 exiting: rc = 0 00000100:00100000:0.0:1788873928.529927:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529942:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529949:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529953:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529959:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529964:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529969:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529973:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529978:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529983:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529988:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529993:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.529998:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530004:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530010:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530016:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530022:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530027:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530032:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530037:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530109:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530121:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530127:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530133:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530138:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530143:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530147:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530152:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530156:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530161:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530166:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530183:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530192:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530198:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530480:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530489:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530495:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530505:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530511:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530516:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530521:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530526:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530531:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530536:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530541:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530545:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530561:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530568:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530574:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530579:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530584:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530590:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530595:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530601:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530606:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530611:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530616:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530621:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530626:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530631:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530636:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530640:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530645:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.530651:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.532197:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d3476f53600:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1788873928.532610:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d347a520000:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1788873928.533020:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d3475e9b800:8432] 2 exiting: rc = 0 00000100:00100000:0.0:1788873928.533196:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534633:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534659:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534665:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534671:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534676:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534681:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534687:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534692:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534697:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534702:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534707:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534733:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534741:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534746:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534752:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534757:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534762:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534767:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534773:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534779:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534785:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534790:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534796:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534801:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534807:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534812:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534817:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534823:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534837:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534843:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534849:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534854:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534860:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534866:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534871:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534889:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534901:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534906:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534912:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534918:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534924:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534930:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534936:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534942:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534948:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534954:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534959:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534965:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534970:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534977:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534983:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534989:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.534995:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535001:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535006:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535012:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535029:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535035:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535338:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535420:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535427:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535433:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.535445:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788873928.541421:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d3476f52200:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1788873928.541637:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d3476f51a00:8434] 1 exiting: rc = 0 00000100:00100000:0.0:1788873928.541745:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541753:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541759:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541764:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541769:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541773:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541778:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541783:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541801:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541806:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541811:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541816:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541821:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541943:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541951:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541956:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541960:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541965:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541970:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541974:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541979:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541984:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541988:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541992:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.541997:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542003:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542008:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542013:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542017:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542022:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542028:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542033:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542038:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542114:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542121:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542126:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542130:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542136:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542141:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542146:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542152:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542158:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542163:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542176:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542182:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542188:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542194:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542199:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542513:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542519:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542524:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542528:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542532:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542537:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542542:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542547:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542561:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542566:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542572:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542576:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542581:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542586:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542591:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.542596:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788873928.543517:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d3476453600:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1788873928.543919:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d3476452e00:8436] 1 exiting: rc = 0 00000100:00100000:0.0:1788873928.545920:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.545938:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.545959:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.545967:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.545973:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.545979:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.545986:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546002:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546009:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546015:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546022:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546029:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546035:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546096:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546118:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546124:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546130:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546137:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546142:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546163:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546170:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546178:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546184:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546191:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546197:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546309:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546317:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546324:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546329:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546335:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546405:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546429:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546436:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546441:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546447:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546453:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546458:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546465:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546470:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546476:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546482:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546488:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546494:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546515:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546521:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546528:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546533:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546540:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.546546:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548114:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548121:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548129:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548136:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548143:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548150:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548172:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548180:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548186:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548194:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548200:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548255:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548260:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548266:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788873928.548279:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788873928.571308:0:15753:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788873946.004478:0:16518:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788873955.328921:0:17134:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788873955.328927:0:17134:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788873955.328928:0:17134:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788873955.329042:0:17134:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3442ab2000 00000020:01000004:1.0:1788873955.329061:0:17134:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788873955.329068:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788873955.329083:0:17134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d33439b0000) 00000020:00000080:1.0:1788873955.329097:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788873955.407822:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788873955.409093:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788873955.410517:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788873955.411718:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788873955.412071:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788873955.412336:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788873955.412580:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788873955.412935:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788873955.413176:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788873955.413692:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788873955.414790:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788873955.415404:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788873955.415673:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788873955.416033:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788873955.417329:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788873955.417561:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788873955.417940:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788873955.418199:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.419290:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.419667:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.420052:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.420271:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.420488:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.420764:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.421091:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.421372:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.421607:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.421981:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.422225:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.422431:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.422731:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.423313:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.423576:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.423957:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.424180:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.424540:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.424816:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.425166:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.425437:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.425690:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.426014:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.426287:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.426546:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788873955.426844:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.427227:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.427435:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788873955.429334:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788873955.430628:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788873955.431192:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788873955.431404:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788873955.432175:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788873955.432386:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788873955.432654:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788873955.433138:0:17134:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788873955.433382:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788873955.433391:0:17134:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788873955.433403:0:17134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c6c3 00000020:01000004:3.0:1788873955.433411:0:17134:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788873955.433415:0:17134:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788873955.433427:0:17134:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3442ab2000 from MGS 00000020:01000004:3.0:1788873955.433431:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788873955.433441:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d33436c99c0) 00000020:00000080:3.0:1788873955.433452:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788873955.433518:0:17134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3442ab2000 from MGS, refs=2 00080000:01000000:3.0:1788873955.433523:0:17134:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788873955.433528:0:17134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c6d1 00000100:00100000:3.0:1788873955.433629:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788873955.433762:0:17134:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788873955.433768:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788873955.434511:0:17134:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788873955.434519:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788873955.438551:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873955.439111:0:17134:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788873955.439118:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788873955.440486:0:17134:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788873955.440495:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788873955.443378:0:17134:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788873955.443395:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788873955.449801:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873955.449806:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788873955.449808:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873955.452093:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873955.452100:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873955.452102:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873955.455283:0:17134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788873955.456405:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788873955.468353:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788873955.470063:0:17146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788873955.470143:0:17134:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788873955.470194:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788873955.471127:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788873955.479841:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873955.480139:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788873955.480149:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788873955.484939:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788873955.484952:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788873955.486186:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788873955.486201:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788873955.489548:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788873955.489574:0:17134:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.120@tcp' 00000020:01000004:2.0:1788873955.489576:0:17134:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788873955.489615:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.120@tcp (typ=mgc) 00000020:00000080:2.0:1788873955.489636:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.120@tcp (ffff9d3342964d40) 00000020:00000080:2.0:1788873955.489653:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788873955.489731:0:17134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d334415b800@MGC192.168.202.120@tcp: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873955.489878:0:17134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.120@tcp-0 is initialized 00000040:01000000:2.0:1788873955.489885:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788873955.490094:0:17151:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788873955.492101:0:17152:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788873955.496232:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.120@tcp (uuid 7a50e61a-7558-480a-b914-36a6e76b41da) 00000020:00000080:2.0:1788873955.496262:0:17134:0:(genops.c:1385:class_connect()) connect: client 7a50e61a-7558-480a-b914-36a6e76b41da, cookie 0x25c660afb0a9c6df 00000100:00080000:2.0:1788873955.496274:0:17134:0:(import.c:545:import_select_connection()) MGC192.168.202.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788873955.496281:0:17134:0:(import.c:665:import_select_connection()) MGC192.168.202.120@tcp: import ffff9d334415b800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873955.496327:0:17134:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a726680 x1875769859152384/t0(0) o250->MGC192.168.202.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873955.496356:0:17134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7a50e61a-7558-480a-b914-36a6e76b41da->MGS 00000020:01000004:2.0:1788873955.496378:0:17134:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788873955.496404:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788873955.496418:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d33429619c0) 00000020:00000080:2.0:1788873955.496430:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788873955.497782:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7a50e61a-7558-480a-b914-36a6e76b41da:3632:1875769859152384:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788873955.497874:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873955.497960:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859152384 00000100:00100000:3.0:1788873955.497969:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859152384 00000100:00100000:3.0:1788873955.500035:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873955.500045:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3632:x1875769859152384:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788873955.500077:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7a50e61a-7558-480a-b914-36a6e76b41da@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:3.0:1788873955.500116:0:17148:0:(genops.c:1385:class_connect()) connect: client 7a50e61a-7558-480a-b914-36a6e76b41da, cookie 0x25c660afb0a9c6ed 00000100:00080000:3.0:1788873955.500430:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d334424d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873955.500527:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+5:3632:x1875769859152384:12345-0@lo:250:mount.lustre.0 Request processed in 482us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.500535:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873955.502343:0:3632:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788873955.502359:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1788873955.502369:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788873955.502376:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788873955.502379:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d334415b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788873955.502383:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788873955.502396:0:3632:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788873955.502405:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7a50e61a-7558-480a-b914-36a6e76b41da:3632:1875769859152384:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788873955.518385:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873955.518569:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788873955.518574:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788873955.525196:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788873955.525386:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788873955.535652:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788873955.535670:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788873955.536544:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788873955.536768:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788873955.536774:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788873955.537397:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788873955.537404:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788873955.598164:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873955.605828:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788873955.605837:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788873955.615959:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788873955.619859:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788873955.620877:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873955.621065:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788873955.621070:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788873955.624455:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788873955.624469:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788873955.626064:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873955.626322:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788873955.626329:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788873955.626818:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788873955.626825:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788873955.627402:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873955.627548:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788873955.627553:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788873955.630310:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788873955.630325:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788873955.669883:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873955.670097:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788873955.670104:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788873955.679434:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788873955.680336:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788873955.681330:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788873955.681340:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788873955.682198:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788873955.682259:0:17134:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788873955.682265:0:17134:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788873955.682391:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788873955.682425:0:17134:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788873955.682429:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788873955.682430:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788873955.682435:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873955.682437:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873955.682438:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873955.682439:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873955.682440:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873955.682441:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788873955.682443:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873955.682444:0:17134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788873955.682446:0:17134:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788873955.682448:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788873955.682449:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788873955.682450:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873955.682451:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873955.682452:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873955.682453:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873955.682454:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873955.682455:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788873955.682456:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873955.682456:0:17134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788873955.682484:0:17134:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788873955.682504:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152512:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788873955.682573:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.682716:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de300 going to sleep for 11 seconds 00000100:00100000:1.0:1788873955.682821:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859152512 00000100:00100000:1.0:1788873955.682829:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859152512 00000100:00100000:1.0:1788873955.682875:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788873955.682884:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+5:17134:x1875769859152512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788873955.682931:0:17150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788873955.682934:0:17150:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788873955.682937:0:17150:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788873955.684168:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788873955.684826:0:17150:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788873955.691717:0:17172:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788873955.691726:0:17172:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788873955.691728:0:17172:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788873955.691730:0:17172:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788873955.691918:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788873955.692095:0:17150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788873955.692103:0:17150:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788873955.694801:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+5:17134:x1875769859152512:12345-0@lo:253:mount.lustre.0 Request processed in 11910us (12220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873955.694813:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873955.694967:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788873955.694984:0:17134:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788873955.694988:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788873955.694989:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788873955.694991:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873955.694992:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873955.694994:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873955.694995:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873955.694997:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873955.694998:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788873955.695001:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873955.695002:0:17134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788873955.695025:0:17134:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3442ab2000 from lustre-MDT0000 10000000:01000000:0.0:1788873955.695056:0:17134:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788873955.695067:0:17134:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788873955.695070:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d3342964d40 10000000:01000000:0.0:1788873955.695073:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873955.695079:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3342964d40 from 1 10000000:01000000:0.0:1788873955.695082:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788873955.695116:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.695124:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.695131:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.695147:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873955.695185:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.695246:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de900 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.695381:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859152640 00000100:00100000:3.0:1788873955.695387:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859152640 00000100:00100000:3.0:1788873955.695421:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788873955.695431:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+5:17134:x1875769859152640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873955.695444:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873955.695458:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442000/0x25c660afb0a9c6fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c6f4 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.695479:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442000/0x25c660afb0a9c6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c6f4 expref: 6 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.695495:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442000/0x25c660afb0a9c6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c6f4 expref: 6 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.695502:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442000, rc 0) 00000100:00100000:3.0:1788873955.695529:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+6:17134:x1875769859152640:12345-0@lo:101:mount.lustre.0 Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.695534:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873955.695667:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873955.695681:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.695689:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.695745:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873955.695764:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.695897:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859152768 00000100:00100000:1.0:1788873955.695901:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859152768 00000100:00100000:1.0:1788873955.695925:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788873955.695938:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+6:17134:x1875769859152768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873955.696006:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+6:17134:x1875769859152768:12345-0@lo:501:mount.lustre.0 Request processed in 68us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788873955.696013:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873955.696054:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.696064:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152768:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788873955.696083:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788873955.696102:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.696110:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873955.696117:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3442ab2000 10000000:01000000:0.0:1788873955.696121:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788873955.696125:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d3442ab2000 10000000:01000000:0.0:1788873955.696128:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788873955.696131:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d3442ab2000 from 1 10000000:01000000:0.0:1788873955.696133:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788873955.696148:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.696155:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.696163:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.696175:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873955.696200:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.696239:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de900 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.696392:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859152896 00000100:00100000:3.0:1788873955.696395:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859152896 00000100:00100000:3.0:1788873955.696416:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873955.696422:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+6:17134:x1875769859152896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873955.696429:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873955.696439:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442e00/0x25c660afb0a9c709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c702 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.696453:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442e00/0x25c660afb0a9c709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c702 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.696462:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442e00/0x25c660afb0a9c709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c702 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.696469:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442e00, rc 0) 00000100:00100000:3.0:1788873955.696496:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+7:17134:x1875769859152896:12345-0@lo:101:mount.lustre.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.696502:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873955.696933:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859152896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873955.696942:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c709 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.696948:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c709 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873955.696966:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788873955.696976:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c709 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.696984:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8a00/0x25c660afb0a9c702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c709 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873955.696990:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788873955.696994:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873955.696998:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d3442ab2000 10000000:01000000:0.0:1788873955.697000:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788873955.697003:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788873955.697005:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788873955.697020:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.697027:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.697035:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.697048:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859153024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873955.697075:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.697097:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873955.697329:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859153024 00000100:00100000:1.0:1788873955.697335:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859153024 00000100:00100000:1.0:1788873955.697374:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873955.697380:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+7:17134:x1875769859153024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873955.697389:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873955.697401:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475ecac00/0x25c660afb0a9c717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c710 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.697416:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecac00/0x25c660afb0a9c717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c710 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.697424:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475ecac00/0x25c660afb0a9c717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c710 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.697430:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecac00, rc 0) 00000100:00100000:1.0:1788873955.697465:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+8:17134:x1875769859153024:12345-0@lo:101:mount.lustre.0 Request processed in 85us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873955.697470:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788873955.697577:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859153024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873955.697588:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c717 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.697603:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c717 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.697737:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859153152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873955.697763:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873955.697914:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859153152 00000100:00100000:3.0:1788873955.697918:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859153152 00000100:00100000:3.0:1788873955.697957:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788873955.697963:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+8:17134:x1875769859153152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873955.698083:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+9:17134:x1875769859153152:12345-0@lo:501:mount.lustre.0 Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.698089:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873955.698341:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.698355:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859153152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873955.698386:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859153280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788873955.698425:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.698487:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de900 going to sleep for 11 seconds 00000100:00100000:2.0:1788873955.698737:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859153280 00000100:00100000:2.0:1788873955.698742:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859153280 00000100:00100000:2.0:1788873955.698772:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788873955.698779:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+9:17134:x1875769859153280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788873955.699516:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+9:17134:x1875769859153280:12345-0@lo:503:mount.lustre.0 Request processed in 735us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873955.699524:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788873955.699638:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859153280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873955.700461:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17173:1875769859153408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873955.700516:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873955.700553:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1788873955.700700:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859153408 00000100:00100000:2.0:1788873955.700707:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859153408 00000100:00100000:2.0:1788873955.700747:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788873955.700755:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+9:17173:x1875769859153408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873955.701256:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+9:17173:x1875769859153408:12345-0@lo:502:llog_process_th.0 Request processed in 499us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873955.701265:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873955.701288:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17173:1875769859153408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873955.701341:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.701353:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.701355:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788873955.701360:0:17173:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788873955.701363:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873955.701376:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d33436c8000) 00000020:00000080:3.0:1788873955.701391:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788873955.701396:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788873955.701479:0:17173:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788873955.701486:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c725 00000020:00000080:3.0:1788873955.701824:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788873955.701829:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.701833:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.701835:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788873955.701838:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.701842:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.701843:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788873955.701846:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873955.701853:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d33436ccd40) 00000020:00000080:3.0:1788873955.701863:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788873955.701875:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788873955.701877:0:17173:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788873955.701880:0:17173:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788873955.701885:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788873955.701938:0:17173:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3442ab2000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788873955.701951:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d33436cb380) 00000020:00000080:3.0:1788873955.701961:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788873955.702003:0:17173:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788873955.702007:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9c73a 00000020:00000080:3.0:1788873955.702091:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788873955.702096:0:17173:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788873955.702099:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x25c660afb0a9c741 00080000:01000000:3.0:1788873955.702104:0:17173:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788873955.702106:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c748 00010000:00010000:3.0:1788873955.775458:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788873955.776045:0:17173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788873955.776470:0:17173:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788873955.777158:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d3476e2cd40) 00000020:00000080:3.0:1788873955.777178:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788873955.777375:0:17173:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788873955.777383:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c756 00000020:00000080:2.0:1788873955.784968:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788873955.787572:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x25c660afb0a9c75d 00000020:00000080:2.0:1788873955.788089:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788873955.788103:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873955.788112:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873955.788114:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788873955.788118:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788873955.788121:0:17173:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788873955.788123:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788873955.788124:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788873955.788126:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788873955.788128:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873955.788129:0:17173:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788873955.788131:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873955.788135:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873955.788137:0:17173:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788873955.788146:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788873955.788184:0:17173:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788873955.788197:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873955.788200:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873955.788232:0:17173:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788873955.788235:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873955.788239:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873955.788240:0:17173:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788873955.788243:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788873955.788248:0:17173:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:00000080:2.0:1788873955.788278:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873955.788302:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9d3342963380) 00000020:00000080:2.0:1788873955.788316:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788873955.788320:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788873955.788367:0:17173:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788873955.788372:0:17173:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788873955.788379:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c76b 00010000:00080000:2.0:1788873955.788412:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3445e97800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873955.794548:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788873955.798997:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788873955.799014:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788873955.799059:0:17173:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788873955.799084:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9c772 00000100:00080000:3.0:1788873955.799097:0:17173:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873955.799104:0:17173:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d3445e97800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873955.799144:0:17173:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343992680 x1875769859153536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873955.799185:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859153536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788873955.799280:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788873955.799369:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788873955.799428:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.799432:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.799435:0:17173:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788873955.799438:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788873955.799441:0:17173:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788873955.799442:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873955.799444:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873955.799446:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788873955.799448:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.799450:0:17173:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788873955.799452:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788873955.799457:0:17173:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788873955.799460:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.799461:0:17173:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788873955.799464:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788873955.799468:0:17173:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:3.0:1788873955.799487:0:17173:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788873955.799489:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873955.799501:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d3476e299c0) 00000020:00000080:3.0:1788873955.799513:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788873955.799516:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788873955.799598:0:17173:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788873955.799604:0:17173:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788873955.799610:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c780 00010000:00080000:3.0:1788873955.799640:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3343a88800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:3.0:1788873955.799835:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788873955.801595:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859153536 00000100:00100000:2.0:1788873955.801609:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859153536 00000100:00100000:2.0:1788873955.801667:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873955.801677:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1875769859153536:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788873955.801698:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1788873955.805405:0:17173:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788873955.806927:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788873955.810778:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873955.811505:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788873955.818746:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788873955.820417:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788873955.820424:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788873955.825771:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788873955.825789:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788873955.825845:0:17173:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788873955.825869:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9c787 00000100:00080000:3.0:1788873955.825881:0:17173:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873955.825887:0:17173:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3343a88800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873955.825924:0:17173:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343990000 x1875769859153664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873955.825953:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788873955.826042:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.826046:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.826048:0:17173:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788873955.826051:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788873955.826054:0:17173:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788873955.826055:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873955.826057:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873955.826058:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788873955.826061:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.826062:0:17173:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788873955.826065:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788873955.826070:0:17173:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788873955.826073:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.826074:0:17173:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788873955.826077:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788873955.826082:0:17173:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:3.0:1788873955.826110:0:17173:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788873955.826112:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873955.826123:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d3476e2b380) 00000020:00000080:3.0:1788873955.826133:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788873955.826138:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788873955.826191:0:17173:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788873955.826197:0:17173:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788873955.826222:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c660afb0a9c795 00010000:00080000:3.0:1788873955.826253:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3342b91800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.120@tcp at head 00000100:00100000:0.0:1788873955.826255:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859153664:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788873955.826341:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859153664 offset 0 length 520: 4 00010000:00010000:3.0:1788873955.826475:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788873955.826546:0:17173:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788873955.826565:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788873955.829736:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1875769859153536:12345-0@lo:38:llog_process_th.0 Request processed in 28051us (30446us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788873955.829755:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788873955.830309:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873955.830316:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788873955.830321:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859153536:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788873955.832985:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873955.833201:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788873955.833403:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788873955.841116:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788873955.841124:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788873955.842750:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788873955.842768:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788873955.842816:0:17173:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788873955.842840:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9c79c 00000100:00080000:3.0:1788873955.842856:0:17173:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873955.842864:0:17173:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3342b91800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873955.842912:0:17173:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343992680 x1875769859153792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873955.842943:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788873955.842987:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859153792:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788873955.842999:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.843003:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.843005:0:17173:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788873955.843008:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.843012:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.843013:0:17173:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788873955.843015:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788873955.843017:0:17173:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788873955.843020:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.843027:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.843028:0:17173:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788873955.843032:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.843034:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.843035:0:17173:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788873955.843038:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:0.0:1788873955.843047:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859153792 offset 0 length 520: 4 00000100:00100000:3.0:1788873955.843066:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17173:1875769859153920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873955.843113:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873955.843145:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344698e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.843278:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859153920 00000100:00100000:0.0:1788873955.843285:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859153920 00000100:00100000:0.0:1788873955.843342:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788873955.843358:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+9:17173:x1875769859153920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873955.843487:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+9:17173:x1875769859153920:12345-0@lo:502:llog_process_th.0 Request processed in 130us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873955.843495:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788873955.843635:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17173:1875769859153920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873955.843662:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.843666:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.843667:0:17173:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788873955.843671:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788873955.844700:0:17134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788873955.844727:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788873955.844801:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c717 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.844815:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9000/0x25c660afb0a9c710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c717 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873955.844824:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3442ab2000 from 1 10000000:01000000:0.0:1788873955.844827:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873955.844863:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.844872:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.844883:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.844901:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873955.844948:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.844985:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.845761:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154048 00000100:00100000:3.0:1788873955.845769:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154048 00000100:00100000:3.0:1788873955.845828:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788873955.845837:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+9:17134:x1875769859154048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873955.845849:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873955.845865:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c7a3 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.845887:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.845898:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.845906:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873955.845969:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+10:17134:x1875769859154048:12345-0@lo:101:mount.lustre.0 Request processed in 132us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.845988:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788873955.846086:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873955.846103:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.846112:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873955.847119:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154176:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788873955.847180:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.847242:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3445533300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.847357:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154176 00000100:00100000:0.0:1788873955.847364:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154176 00000100:00100000:0.0:1788873955.847401:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788873955.847415:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+10:17134:x1875769859154176:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788873955.847433:0:17148:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788873955.847440:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788873955.847503:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+10:17134:x1875769859154176:12345-0@lo:256:mount.lustre.0 Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873955.847511:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788873955.848038:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154176:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788873955.850924:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788873955.853090:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.853106:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873955.853116:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3442ab2000 from 1 10000000:01000000:1.0:1788873955.853119:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873955.853167:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.853176:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.853188:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873955.853240:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788873955.853318:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.853352:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154304 00000100:00100000:1.0:1788873955.853358:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3445533300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.853360:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154304 00000100:00100000:0.0:1788873955.853411:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788873955.853421:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+10:17134:x1875769859154304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873955.853433:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873955.853447:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c7b1 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.853471:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.853478:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.853485:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9800, rc 0) 00000100:00100000:0.0:1788873955.853521:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859154304:12345-0@lo:101:mount.lustre.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873955.853528:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788873955.853849:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873955.853879:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873955.853890:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873955.853948:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873955.853974:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.854030:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3445533300 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.854065:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154432 00000100:00100000:3.0:1788873955.854070:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154432 00000100:00100000:3.0:1788873955.854129:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788873955.854138:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859154432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873955.854312:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859154432:12345-0@lo:501:mount.lustre.0 Request processed in 175us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.854319:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788873955.854386:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873955.854415:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788873955.854448:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.854475:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de840 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.854481:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154560 00000100:00100000:3.0:1788873955.854485:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154560 00000100:00100000:3.0:1788873955.854510:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788873955.854517:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859154560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873955.854903:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859154560:12345-0@lo:503:mount.lustre.0 Request processed in 386us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.854910:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788873955.858505:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873955.859667:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17183:1875769859154688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873955.859751:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873955.859804:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344829ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873955.859919:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154688 00000100:00100000:1.0:1788873955.859927:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154688 00000100:00100000:1.0:1788873955.859980:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788873955.859991:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+11:17183:x1875769859154688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.860508:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+11:17183:x1875769859154688:12345-0@lo:502:llog_process_th.0 Request processed in 518us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873955.860517:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873955.860563:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17183:1875769859154688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873955.860754:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.860765:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860767:0:17183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788873955.860774:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3442ab2000 00000020:00000080:3.0:1788873955.860776:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873955.860784:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.860786:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860795:0:17183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788873955.860798:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.860801:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860802:0:17183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788873955.860805:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3442ab2000 00000020:00000080:3.0:1788873955.860807:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873955.860867:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.860871:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860872:0:17183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788873955.860875:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.860877:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860878:0:17183:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873955.860882:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3442ab2000 00000020:00000080:3.0:1788873955.860884:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873955.860899:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.860902:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860903:0:17183:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873955.860905:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873955.860907:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.860908:0:17183:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788873955.860910:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3442ab2000 00000020:00000080:3.0:1788873955.860912:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788873955.860946:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17183:1875769859154816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788873955.860984:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873955.865611:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344829ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.870508:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154816 00000100:00100000:0.0:1788873955.870524:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154816 00000100:00100000:0.0:1788873955.870598:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788873955.870611:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+11:17183:x1875769859154816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788873955.871702:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+11:17183:x1875769859154816:12345-0@lo:502:llog_process_th.0 Request processed in 1090us (10712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873955.871716:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873955.871913:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17183:1875769859154816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788873955.871952:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873955.871960:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873955.871963:0:17183:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788873955.871967:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788873955.872130:0:17134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788873955.872156:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873955.872180:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.872192:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873955.872269:0:17134:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788873955.872273:0:17134:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3442ab2000 10000000:01000000:0.0:1788873955.872276:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3442ab2000 10000000:01000000:0.0:1788873955.872280:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873955.872286:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3442ab2000 from 1 10000000:01000000:0.0:1788873955.872289:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788873955.872332:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.872341:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.872364:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.872386:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873955.872438:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.872481:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.876476:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859154944 00000100:00100000:3.0:1788873955.876513:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859154944 00000100:00100000:3.0:1788873955.876607:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788873955.876617:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859154944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873955.876635:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873955.876657:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443200/0x25c660afb0a9c7c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c7bf expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.876688:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443200/0x25c660afb0a9c7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c7bf expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.876700:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443200/0x25c660afb0a9c7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7bf expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.876708:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443200, rc 0) 00000100:00100000:3.0:1788873955.876805:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17134:x1875769859154944:12345-0@lo:101:mount.lustre.0 Request processed in 189us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.876812:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788873955.877711:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859154944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873955.877734:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7c6 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.877746:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c7c6 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873955.877829:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859155072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873955.877871:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873955.877911:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.879617:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155072 00000100:00100000:3.0:1788873955.879632:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155072 00000100:00100000:3.0:1788873955.879713:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873955.879724:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17134:x1875769859155072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873955.879901:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17134:x1875769859155072:12345-0@lo:501:mount.lustre.0 Request processed in 179us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.879909:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788873955.880449:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859155072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873955.880504:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859155200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873955.880572:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.880853:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873955.880908:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155200 00000100:00100000:3.0:1788873955.880914:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155200 00000100:00100000:3.0:1788873955.880950:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788873955.880956:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+12:17134:x1875769859155200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873955.881070:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+12:17134:x1875769859155200:12345-0@lo:503:mount.lustre.0 Request processed in 113us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873955.881078:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873955.881160:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859155200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873955.886026:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17186:1875769859155328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.886119:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.886166:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788873955.886245:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155328 00000100:00100000:2.0:1788873955.886253:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155328 00000100:00100000:2.0:1788873955.886306:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788873955.886322:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17186:x1875769859155328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788873955.886454:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17186:x1875769859155328:12345-0@lo:502:llog_process_th.0 Request processed in 133us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873955.886462:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788873955.888345:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17186:1875769859155328:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788873955.888427:0:17186:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788873955.888443:0:17186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d33439b4d40) 00000020:00000080:1.0:1788873955.888463:0:17186:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788873955.888579:0:17186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3442ab2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788873955.888584:0:17186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3442ab2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788873955.888586:0:17186:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3442ab2000 4 00010000:00080000:1.0:1788873955.888626:0:17186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d33428eb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.120@tcp at head 00010000:00010000:1.0:1788873955.890271:0:17186:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788873955.890506:0:17186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788873955.890547:0:17186:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788873955.890560:0:17186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x25c660afb0a9c7d4 00000100:00080000:1.0:1788873955.890572:0:17186:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873955.890578:0:17186:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d33428eb800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873955.890613:0:17186:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f356300 x1875769859155456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788873955.890667:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769859155456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788873955.890739:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.890815:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155456 00000100:00100000:1.0:1788873955.890822:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155456 00000100:00100000:1.0:1788873955.890851:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873955.890858:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859155456:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788873955.890908:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859155456:12345-0@lo:38:llog_process_th.0 Request processed in 49us (168us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788873955.890915:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873955.890947:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788873955.890955:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873955.890969:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788873955.890996:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769859155456:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788873955.891028:0:17186:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788873955.891269:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17186:1875769859155584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.904903:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.904949:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155584 00000100:00100000:1.0:1788873955.904958:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155584 00000100:00100000:1.0:1788873955.905005:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788873955.905016:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17186:x1875769859155584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.905151:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17186:x1875769859155584:12345-0@lo:502:llog_process_th.0 Request processed in 137us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873955.905159:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788873955.905229:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873955.905251:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17186:1875769859155584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.905325:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17186:1875769859155712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.905362:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873955.905382:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155712 00000100:00100000:1.0:1788873955.905385:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155712 00000100:00100000:1.0:1788873955.905406:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788873955.905412:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+12:17186:x1875769859155712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788873955.905476:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+12:17186:x1875769859155712:12345-0@lo:502:llog_process_th.0 Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873955.905483:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788873955.905511:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873955.905521:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a50e61a-7558-480a-b914-36a6e76b41da:17186:1875769859155712:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788873955.905558:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788873955.905900:0:17134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788873955.905928:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788873955.905943:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7c6 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.905954:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8e00/0x25c660afb0a9c7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7c6 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788873955.906006:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788873955.906008:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788873955.906010:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873955.906011:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873955.906012:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873955.906014:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873955.906016:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788873955.906017:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788873955.906019:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873955.906020:0:17134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788873955.906023:0:17134:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788873955.906026:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788873955.906027:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788873955.906028:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873955.906029:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873955.906030:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873955.906031:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873955.906032:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788873955.906033:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788873955.906034:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873955.906035:0:17134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788873955.906050:0:17134:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788873955.906063:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859155840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788873955.906098:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873955.906122:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58840 going to sleep for 11 seconds 00000100:00100000:1.0:1788873955.907709:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155840 00000100:00100000:1.0:1788873955.907720:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155840 00000100:00100000:1.0:1788873955.907762:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788873955.907769:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17134:x1875769859155840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788873955.907795:0:17150:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788873955.907807:0:17150:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788873955.934845:0:17150:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788873955.934863:0:17150:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788873955.936697:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788873955.936707:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788873955.936742:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.936765:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.936774:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.936819:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.936838:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 12 pid: 17150 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873955.936855:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859155968:0@lo:104: 00000100:00100000:2.0:1788873955.936926:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873955.936970:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873955.942140:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859155968 00000100:00100000:0.0:1788873955.942152:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859155968 00000100:00100000:0.0:1788873955.942254:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873955.942265:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859155968:12345-0@lo:104: 00010000:00010000:0.0:1788873955.942283:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.942390:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788873955.942397:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859155968:12345-0@lo:104: Request processed in 135us (5471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873955.942421:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788873955.942470:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859155968:0@lo:104: 00010000:00010000:0.0:1788873955.942496:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.942731:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873955.942739:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.942748:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873955.942752:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.942761:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873955.942767:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873955.942773:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873955.942814:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.942822:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873955.942848:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.942855:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7aa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873955.942873:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873955.942875:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873955.942883:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873955.942908:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873955.942922:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859156096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873955.942960:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873955.943067:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156096 00000100:00100000:2.0:1788873955.943072:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156096 00010000:00010000:2.0:1788873955.943092:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 13 pid: 17150 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873955.943111:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873955.943118:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+13:3635:x1875769859156096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788873955.943135:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788873955.943141:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 13 pid: 17150 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943150:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 13 pid: 17150 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943162:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c7a3 expref: 13 pid: 17150 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943175:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943183:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788873955.943197:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006491093s 00010000:00010000:2.0:1788873955.943232:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943240:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943248:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943255:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943259:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788873955.943263:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943277:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943299:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873955.943309:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788873955.943344:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+12:3635:x1875769859156096:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873955.943351:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788873955.943491:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.943499:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873955.943505:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d33442b2200/0x25c660afb0a9c7db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873955.943829:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859156096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873955.944079:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+11:17134:x1875769859155840:12345-0@lo:253:mount.lustre.0 Request processed in 36310us (37979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873955.944089:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788873955.945925:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17134:1875769859155840:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788873955.945944:0:17134:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788873955.945947:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788873955.945949:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788873955.945951:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873955.945952:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873955.945953:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873955.945954:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873955.945956:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788873955.945957:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788873955.945959:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873955.945960:0:17134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788873955.945973:0:17134:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1788873955.967619:0:17134:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788873955.968031:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788873955.970960:0:17196:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788873955.971237:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788873955.971627:0:17196:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788873955.972514:0:17197:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9d347a724000 x1875769859156224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873955.972527:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00000040:01000000:0.0:1788873955.972948:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788873955.973005:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788873955.973493:0:17134:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788873955.973520:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788873955.973574:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873955.974547:0:17134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788873955.975090:0:17134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788873955.975123:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:1.0:1788873955.979652:0:17195:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788873955.979662:0:17195:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788873955.980051:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788873955.980149:0:17196:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1788873955.982356:0:17134:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788873955.987724:0:17134:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788873955.991031:0:17134:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788873955.991073:0:17134:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcd1818f7988 00100000:10000000:0.0:1788873955.991082:0:17134:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788873955.996862:0:17134:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788873955.996884:0:17134:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788873955.996904:0:17134:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788873955.996927:0:17134:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788873955.999120:0:17134:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873956.001859:0:17134:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873956.471175:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873956.911392:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788873956.976413:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 10000000:01000000:2.0:1788873957.166803:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788873957.166812:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3442ab2000 from 7 10000000:01000000:2.0:1788873957.166818:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788873957.166901:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873957.166913:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873957.166934:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873957.166973:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859156352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788873957.167053:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873957.167137:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58180 going to sleep for 11 seconds 00000100:00100000:1.0:1788873957.168296:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156352 00000100:00100000:1.0:1788873957.168309:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156352 00000100:00100000:1.0:1788873957.168398:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788873957.168408:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+11:17152:x1875769859156352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873957.168423:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873957.168439:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c7e2 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873957.168485:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873957.168497:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873957.168507:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca600, rc 0) 00000100:00100000:1.0:1788873957.168583:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17152:x1875769859156352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873957.168598:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788873957.168787:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859156352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873957.168808:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873957.168817:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873957.168890:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859156480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788873957.168946:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873957.169330:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344829e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788873957.169901:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156480 00000100:00100000:1.0:1788873957.169977:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156480 00000100:00100000:1.0:1788873957.170031:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788873957.170040:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17152:x1875769859156480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788873957.170071:0:17150:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788873957.170092:0:17150:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788873957.170095:0:17150:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788873957.171426:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17152:x1875769859156480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1381us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873957.171437:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788873957.172402:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859156480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788873957.172468:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873957.172477:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873957.172489:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873957.486922:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788873957.934891:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788873957.998470:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:1.0:1788873958.513355:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873959.022311:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:0.0:1788873959.538063:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788873959.794038:0:17439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788873960.049025:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:2.0:1788873960.560980:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788873960.569485:0:17492:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873960.569697:0:17492:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788873961.070280:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00000100:00100000:3.0:1788873961.198697:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859156608:0@lo:400:kworker.0 00000100:00100000:3.0:1788873961.198783:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873961.198884:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156608 00000100:00100000:1.0:1788873961.198893:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156608 00000100:00100000:1.0:1788873961.198970:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788873961.198980:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:3633:x1875769859156608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788873961.199049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788873961.199054:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788873961.199058:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873961.199065:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1788873961.199070:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788873961.199076:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d3445e97800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873961.199124:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a724e00 x1875769859156736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873961.199141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873961.199145:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873961.199147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873961.199150:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873961.199159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788873961.199162:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788873961.199164:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d33428eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873961.199170:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d33428eb800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873961.199180:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859156736:0@lo:38:kworker.0 00000100:00100000:2.0:1788873961.199278:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873961.199324:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156736 00000100:00100000:2.0:1788873961.199329:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156736 00000100:00100000:2.0:1788873961.199351:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873961.199356:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859156736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788873961.199373:0:17161:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788873961.202678:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:3633:x1875769859156608:12345-0@lo:400:kworker.0 Request processed in 3687us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873961.202695:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788873961.202797:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859156608:0@lo:400:kworker.0 00000100:00100000:3.0:1788873961.208609:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343993100 x1875769859156864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788873961.208726:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769859156864:0@lo:38:kworker.0 00000100:00100000:1.0:1788873961.208865:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873961.209136:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859156736:12345-0@lo:38:kworker.0 Request processed in 9776us (9855us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788873961.209151:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788873961.209285:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873961.209300:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788873961.209305:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859156736:0@lo:38:kworker.0 00000100:00100000:3.0:1788873961.210412:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156864 00000100:00100000:3.0:1788873961.210426:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156864 00000100:00100000:3.0:1788873961.210504:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788873961.210513:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769859156864:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788873961.210545:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1788873961.210588:0:17157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x25c660afb0a9c7f0 00000004:00100000:3.0:1788873961.210608:0:17157:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788873961.210839:0:17157:0:(import.c:65:import_set_state_nolock()) ffff9d3444c84800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873961.211007:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875769859156864:12345-0@lo:38:kworker.0 Request processed in 491us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873961.211014:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788873961.211105:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3343993100 x1875769859156864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873961.211126:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788873961.211135:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788873961.211140:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788873961.211142:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788873961.211147:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875769859156864:0@lo:38:kworker.0 00000020:00000004:3.0:1788873961.403620:0:17542:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873961.403994:0:17542:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788873961.596187:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873962.094285:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:2.0:1788873962.607555:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873963.118535:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:0.0:1788873963.632167:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873964.142335:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:2.0:1788873964.655639:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873965.168085:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00000100:00100000:1.0:1788873965.294663:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873955/real 1788873955] req@ffff9d3343992680 x1875769859153792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873965 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873965.294690:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343992680 x1875769859153792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873965 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873965.294705:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873955/real 1788873955] req@ffff9d3343990000 x1875769859153664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873965 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873965.294717:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343990000 x1875769859153664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873965 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788873965.294734:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873965.294755:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788873965.294759:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859153792:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788873965.294764:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873965.294768:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788873965.294777:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859153664:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788873965.297326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788873965.297334:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788873965.297337:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873965.297345:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1788873965.297351:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788873965.297358:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d3445e97800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873965.297382:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a724e00 x1875769859157120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873965.297398:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873965.297401:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788873965.297403:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873965.297406:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1788873965.297409:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788873965.297409:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859156992:0@lo:400:kworker.0 00000100:00080000:2.0:1788873965.297413:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3343a88800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873965.297424:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a724700 x1875769859157248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873965.297432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873965.297435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788873965.297437:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873965.297440:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1788873965.297443:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788873965.297446:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3342b91800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873965.297456:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a727b80 x1875769859157376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873965.297476:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873965.297578:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859157504:0@lo:400:kworker.0 00000100:00100000:2.0:1788873965.297590:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156992 00000100:00100000:2.0:1788873965.297597:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156992 00000100:00100000:0.0:1788873965.297612:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873965.297655:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788873965.297666:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:3634:x1875769859156992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873965.297726:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:3634:x1875769859156992:12345-0@lo:400:kworker.0 Request processed in 62us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873965.297734:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873965.297791:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859156992:0@lo:400:kworker.0 00000100:00100000:1.0:1788873965.297873:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859157504 00000100:00100000:1.0:1788873965.297878:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859157504 00000100:00100000:1.0:1788873965.297913:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788873965.297921:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859157504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873965.297964:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859157504:12345-0@lo:400:kworker.0 Request processed in 45us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873965.297970:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788873965.297996:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d347a724a80 x1875769859157504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873965.298006:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859157504:0@lo:400:kworker.0 00000100:00100000:1.0:1788873965.298035:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859157120:0@lo:38:kworker.0 00000100:00100000:1.0:1788873965.298062:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873965.298081:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859157248:0@lo:8:kworker.0 00000400:00000100:1.0:1788873965.298101:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859157248 offset 0 length 520: 4 00000100:00100000:1.0:1788873965.298111:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859157376:0@lo:8:kworker.0 00000400:00000100:1.0:1788873965.298127:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859157376 offset 0 length 520: 4 00000100:00100000:1.0:1788873965.298151:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859157120 00000100:00100000:1.0:1788873965.298154:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859157120 00000100:00100000:1.0:1788873965.298170:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873965.298174:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1875769859157120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788873965.298190:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788873965.314071:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1875769859157120:12345-0@lo:38:kworker.0 Request processed in 15885us (15997us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788873965.314103:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788873965.314161:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873965.314167:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788873965.314171:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859157120:0@lo:38:kworker.0 00010000:00010000:0.0:1788873965.678454:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873966.190285:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:2.0:1788873966.702465:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788873967.151788:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788873967.214958:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00000020:01000004:3.0:1788873967.678940:0:17887:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788873967.678944:0:17887:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788873967.678946:0:17887:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788873967.679060:0:17887:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3475f37800 00000020:01000004:3.0:1788873967.679085:0:17887:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788873967.679097:0:17887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788873967.679110:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9d3476e28000) 00000020:00000080:3.0:1788873967.679126:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788873967.726489:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788873967.734734:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.735169:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788873967.735733:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788873967.735981:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788873967.736142:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788873967.736608:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788873967.736887:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788873967.737108:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788873967.737417:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788873967.737632:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788873967.737901:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788873967.738109:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788873967.738418:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788873967.738650:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788873967.741891:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.742097:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.742425:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.742599:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.742853:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.743014:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.743172:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.743553:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.743820:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.744045:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.744267:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.744540:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.744840:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.745066:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.745714:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.746040:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.746246:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.746514:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.746824:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.747163:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.747537:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.747834:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.748071:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.748273:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.748542:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.748829:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.749005:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.749193:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.749556:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.749841:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788873967.750067:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788873967.750288:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00080000:01000000:0.0:1788873967.751151:0:17887:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788873967.751610:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788873967.751622:0:17887:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788873967.751635:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9c7fe 00000020:01000004:0.0:1788873967.751642:0:17887:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788873967.751666:0:17887:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788873967.751682:0:17887:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788873967.751688:0:17887:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788873967.751715:0:17887:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788873967.751719:0:17887:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788873967.756467:0:17887:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788873967.756511:0:17887:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.120@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788873967.756515:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788873967.756517:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788873967.756518:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873967.756519:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873967.756521:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873967.756522:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873967.756523:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873967.756525:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873967.756526:0:17887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788873967.756530:0:17887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788873967.756533:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788873967.756534:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788873967.756535:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873967.756541:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873967.756543:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873967.756544:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873967.756545:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873967.756546:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873967.756547:0:17887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788873967.756580:0:17887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788873967.756604:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859157632:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788873967.756814:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.756932:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873967.757025:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859157632 00000100:00100000:1.0:1788873967.757033:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859157632 00000100:00100000:1.0:1788873967.757125:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788873967.757137:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17887:x1875769859157632:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788873967.757190:0:17149:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788873967.757194:0:17149:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788873967.757278:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788873967.757732:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+12:17887:x1875769859157632:12345-0@lo:253:mount.lustre.0 Request processed in 597us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.757751:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788873967.757956:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859157632:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788873967.757966:0:17887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788873967.757968:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788873967.757970:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788873967.757971:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873967.757972:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873967.757974:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873967.757975:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873967.757976:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788873967.757977:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873967.757978:0:17887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788873967.757996:0:17887:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3475f37800 from lustre-MDT0001 10000000:01000000:0.0:1788873967.758025:0:17887:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788873967.758028:0:17887:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788873967.758034:0:17887:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3342964d40 local copy 00010000:00010000:0.0:1788873967.758043:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.758128:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859157760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873967.758161:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.758238:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.758287:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859157760 00000100:00100000:2.0:1788873967.758292:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859157760 00000100:00100000:2.0:1788873967.758331:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788873967.758339:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17887:x1875769859157760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873967.758407:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+12:17887:x1875769859157760:12345-0@lo:501:mount.lustre.0 Request processed in 69us (246us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873967.758414:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788873967.758529:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859157760:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788873967.758542:0:17887:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788873967.758575:0:17887:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788873967.758581:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.758591:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.758618:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3475f37800 10000000:01000000:0.0:1788873967.758623:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788873967.758629:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d3342964d40 10000000:01000000:0.0:1788873967.758631:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788873967.758636:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d3342964d40 from 1 10000000:01000000:0.0:1788873967.758640:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788873967.758664:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.758735:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.758813:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.758827:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859157888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873967.758853:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.758880:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.758975:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859157888 00000100:00100000:3.0:1788873967.758979:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859157888 00000100:00100000:3.0:1788873967.759004:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788873967.759011:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+12:17887:x1875769859157888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873967.759020:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873967.759033:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442600/0x25c660afb0a9c80c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c805 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.759053:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442600/0x25c660afb0a9c80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c805 expref: 13 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.759064:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442600/0x25c660afb0a9c80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c805 expref: 13 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.759072:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442600, rc 0) 00000100:00100000:3.0:1788873967.759108:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+13:17887:x1875769859157888:12345-0@lo:101:mount.lustre.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.759114:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788873967.759273:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859157888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873967.759287:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c80c expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.759297:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c80c expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.759423:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788873967.759440:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c80c expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.759449:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8000/0x25c660afb0a9c805 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c80c expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.759457:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d3475f37800 10000000:01000000:0.0:1788873967.759461:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788873967.759465:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d3475f37800 from 1 10000000:01000000:0.0:1788873967.759467:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788873967.759483:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.759491:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.759498:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.759511:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873967.759537:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.759632:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873967.759700:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158016 00000100:00100000:1.0:1788873967.759705:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158016 00000100:00100000:1.0:1788873967.759933:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788873967.759945:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+13:17887:x1875769859158016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873967.759953:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873967.759963:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9c81a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c813 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873967.759979:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9c81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c813 expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873967.759989:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475ecbe00/0x25c660afb0a9c81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c813 expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873967.760009:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecbe00, rc 0) 00000100:00100000:1.0:1788873967.760053:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+14:17887:x1875769859158016:12345-0@lo:101:mount.lustre.0 Request processed in 112us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873967.760093:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873967.760104:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c81a expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.760112:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c81a expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.760130:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788873967.760139:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c81a expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.760146:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9e00/0x25c660afb0a9c813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c81a expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.760153:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788873967.760156:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873967.760160:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d3475f37800 10000000:01000000:0.0:1788873967.760162:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788873967.760165:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788873967.760168:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788873967.760192:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.760200:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.760393:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.760464:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873967.760491:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.760506:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.760643:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158144 00000100:00100000:2.0:1788873967.760648:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158144 00000100:00100000:1.0:1788873967.760893:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788873967.761001:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788873967.761010:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+14:17887:x1875769859158144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788873967.761020:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873967.761030:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33442b3000/0x25c660afb0a9c828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c821 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.761048:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33442b3000/0x25c660afb0a9c828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c821 expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.761057:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33442b3000/0x25c660afb0a9c828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c821 expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.761064:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b3000, rc 0) 00000100:00100000:2.0:1788873967.761114:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158144:12345-0@lo:101:mount.lustre.0 Request processed in 106us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.761120:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873967.761188:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873967.761222:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c828 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.761239:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c828 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873967.762627:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788873967.763291:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873967.767105:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788873967.767157:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788873967.767170:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788873967.767194:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788873967.767456:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788873967.767472:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788873967.767484:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788873967.767497:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788873967.767509:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788873967.767520:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788873967.767531:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788873967.767542:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788873967.767555:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788873967.767566:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788873967.767577:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788873967.767588:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788873967.767599:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788873967.767609:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788873967.767620:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788873967.767630:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788873967.767641:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788873967.767651:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788873967.767662:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788873967.767696:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788873967.767702:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788873967.767901:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873967.767968:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.768012:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34479769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.768073:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158272 00000100:00100000:3.0:1788873967.768080:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158272 00000100:00100000:3.0:1788873967.768128:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788873967.768137:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873967.768409:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158272:12345-0@lo:501:mount.lustre.0 Request processed in 271us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.768417:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788873967.768533:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873967.768565:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788873967.768606:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.768625:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34479769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.768688:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158400 00000100:00100000:3.0:1788873967.768692:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158400 00000100:00100000:3.0:1788873967.768727:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788873967.768733:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873967.769632:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158400:12345-0@lo:503:mount.lustre.0 Request processed in 895us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.769642:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788873967.769894:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788873967.770440:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873967.770510:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873967.770575:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.770665:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3342847300 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.770807:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158528 00000100:00100000:3.0:1788873967.770813:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158528 00000100:00100000:3.0:1788873967.770899:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873967.770907:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873967.772665:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158528:12345-0@lo:502:mount.lustre.0 Request processed in 1753us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.772677:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788873967.773390:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873967.773653:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788873967.773835:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788873967.773859:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788873967.773874:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788873967.773890:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788873967.773906:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788873967.773921:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788873967.773936:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788873967.773952:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788873967.773969:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788873967.773985:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788873967.774003:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788873967.774015:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788873967.774026:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788873967.774047:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788873967.774077:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788873967.774092:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788873967.774106:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788873967.774120:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788873967.774132:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788873967.774142:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788873967.774152:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788873967.774162:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788873967.774173:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788873967.774198:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788873967.774825:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788873967.774845:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788873967.774857:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788873967.774869:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788873967.774884:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788873967.774899:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788873967.774913:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788873967.774928:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788873967.774943:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788873967.775065:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788873967.775080:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788873967.775091:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788873967.775103:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788873967.775116:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788873967.775127:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788873967.775138:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788873967.775149:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788873967.775161:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788873967.775172:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788873967.775418:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873967.775491:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.775534:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.775658:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158656 00000100:00100000:3.0:1788873967.775666:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158656 00000100:00100000:3.0:1788873967.775838:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873967.775848:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873967.775979:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859158656:12345-0@lo:502:mount.lustre.0 Request processed in 132us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.775987:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788873967.776066:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859158656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873967.776122:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788873967.776133:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788873967.777410:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873967.777424:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873967.777426:0:17891:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788873967.777432:0:17891:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788873967.777436:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788873967.777451:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9d33439b3380) 00000020:00000080:1.0:1788873967.777474:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788873967.777481:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788873967.777583:0:17891:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788873967.777590:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9c836 00000020:00000080:1.0:1788873967.777968:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788873967.777973:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788873967.777977:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873967.777978:0:17891:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788873967.777981:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788873967.777986:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788873967.777988:0:17891:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788873967.777991:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788873967.777998:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9d33439b19c0) 00000020:00000080:1.0:1788873967.778010:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788873967.778015:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788873967.778017:0:17891:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788873967.778020:0:17891:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788873967.778026:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788873967.778078:0:17891:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3475f37800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788873967.778091:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9d3475d80000) 00000020:00000080:1.0:1788873967.778108:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788873967.778197:0:17891:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788873967.778409:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9c84b 00000020:00000080:1.0:1788873967.778509:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788873967.778517:0:17891:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788873967.778522:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x25c660afb0a9c852 00080000:01000000:1.0:1788873967.778528:0:17891:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788873967.778532:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9c859 00010000:00010000:2.0:1788873967.845691:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788873967.846193:0:17891:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788873967.846518:0:17891:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788873967.847687:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788873967.847700:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873967.847706:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873967.847708:0:17891:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788873967.847713:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873967.847719:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873967.847720:0:17891:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788873967.847723:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788873967.847728:0:17891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:00000080:2.0:1788873967.847856:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788873967.847870:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9d3342960000) 00000020:00000080:2.0:1788873967.847892:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788873967.847897:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788873967.847977:0:17891:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788873967.847985:0:17891:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788873967.847992:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9c867 00010000:00080000:2.0:1788873967.848023:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3458478800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873967.850145:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788873967.853606:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788873967.853620:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788873967.853656:0:17891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788873967.853803:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9c86e 00000100:00080000:3.0:1788873967.853816:0:17891:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873967.853822:0:17891:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d3458478800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873967.853869:0:17891:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343990380 x1875769859158784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873967.853893:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788873967.853920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788873967.853925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788873967.853928:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873967.853932:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:3.0:1788873967.853937:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788873967.853941:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d3445e97800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873967.853941:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859158784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788873967.853953:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343991c00 x1875769859158912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873967.853963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873967.853966:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873967.853969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873967.853971:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788873967.854010:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788873967.854054:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.854059:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788873967.854059:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859158912:0@lo:38:kworker.0 00000020:00000080:3.0:1788873967.854061:0:17891:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788873967.854064:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788873967.854066:0:17891:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788873967.854068:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873967.854070:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873967.854071:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788873967.854073:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.854075:0:17891:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788873967.854077:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1788873967.854081:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788873967.854082:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.854088:0:17891:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788873967.854093:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788873967.854106:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859159040:0@lo:400:kworker.0 00000004:01000000:3.0:1788873967.854127:0:17891:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788873967.854130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788873967.854144:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.854148:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.854149:0:17891:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788873967.854152:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788873967.854154:0:17891:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788873967.854155:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873967.854156:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873967.854158:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788873967.854160:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.854161:0:17891:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000100:00100000:0.0:1788873967.854162:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158784 00000020:01000000:3.0:1788873967.854163:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788873967.854166:0:17891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000100:00100000:0.0:1788873967.854168:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158784 00000020:00000080:3.0:1788873967.854169:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.854170:0:17891:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788873967.854173:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788873967.854189:0:17891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000100:00100000:0.0:1788873967.854199:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859158912 00000100:00100000:0.0:1788873967.854201:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859158912 00000100:00100000:0.0:1788873967.854236:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873967.854243:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859158784:12345-0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788873967.854257:0:17891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788873967.854260:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00010000:00080000:0.0:1788873967.854266:0:17161:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1788873967.854273:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d3480da3380) 00000020:00000080:3.0:1788873967.854284:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788873967.854288:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:00000080:0.0:1788873967.854310:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9c875 00000004:00100000:0.0:1788873967.854324:0:17161:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788873967.854330:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788873967.854418:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859159040 00000100:00100000:0.0:1788873967.854423:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859159040 00000004:00080000:3.0:1788873967.855249:0:17891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788873967.855258:0:17891:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788873967.855265:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9c883 00010000:00080000:3.0:1788873967.855297:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d34505d4800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.120@tcp at head 00000100:00100000:0.0:1788873967.855890:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873967.855900:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859159040:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788873967.855960:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788873967.855971:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859159040:12345-0@lo:400:kworker.0 Request processed in 73us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873967.855978:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788873967.856030:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3343991500 x1875769859159040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873967.856045:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859159040:0@lo:400:kworker.0 00000040:01000000:3.0:1788873967.858706:0:17891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788873967.859405:0:17891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788873967.861366:0:17891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788873967.861706:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788873967.861882:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1788873967.862655:0:17161:0:(import.c:65:import_set_state_nolock()) ffff9d3475ce6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788873967.862769:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3632:x1875769859158784:12345-0@lo:38:llog_process_th.0 Request processed in 8524us (8756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.862780:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788873967.862810:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788873967.862817:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859158912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788873967.862860:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1875769859158912:12345-0@lo:38:kworker.0 Request processed in 43us (8777us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788873967.862866:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788873967.862876:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788873967.862885:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788873967.862889:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788873967.862893:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859158912:0@lo:38:kworker.0 00000100:00100000:2.0:1788873967.862910:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788873967.862923:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788873967.862931:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788873967.862936:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788873967.862939:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3458478800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1788873967.862945:0:17896:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788873967.862949:0:17896:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788873967.862998:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859158784:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788873967.863994:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788873967.864006:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788873967.864042:0:17891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788873967.864062:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9c88a 00000100:00080000:3.0:1788873967.864070:0:17891:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873967.864075:0:17891:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d34505d4800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873967.864104:0:17891:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343992a00 x1875769859159168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788873967.864172:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859159168:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788873967.864249:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859159168 offset 0 length 520: 4 00000100:00080000:3.0:1788873967.864313:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788873967.864369:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.864373:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.864375:0:17891:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788873967.864379:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788873967.864382:0:17891:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788873967.864384:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873967.864385:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873967.864387:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788873967.864389:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.864390:0:17891:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788873967.864403:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788873967.864408:0:17891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788873967.864411:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.864412:0:17891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788873967.864416:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788873967.864420:0:17891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.120@tcp to nid 0x20000c0a8ca78 (192.168.202.120@tcp) 00000020:01000000:3.0:1788873967.864449:0:17891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788873967.864452:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873967.864463:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d3480da19c0) 00000020:00000080:3.0:1788873967.864474:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788873967.864484:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788873967.864565:0:17891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788873967.864572:0:17891:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788873967.864578:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c660afb0a9c898 00010000:00080000:3.0:1788873967.864605:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d33428ea800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:3.0:1788873967.864825:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788873967.864892:0:17891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788873967.864907:0:17891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788873967.865194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873967.865199:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788873967.865201:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873967.865231:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788873967.866628:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788873967.866647:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859159296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873967.866712:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873967.866905:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859159296 00000100:00100000:1.0:1788873967.866913:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859159296 00000100:00100000:1.0:1788873967.867201:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873967.867294:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875769859159296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873967.867328:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788873967.867720:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875769859159296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 428us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.867729:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788873967.867891:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859159296:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788873967.868043:0:17891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788873967.868255:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788873967.868616:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788873967.870765:0:17898:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788873967.870780:0:17898:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788873967.872633:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788873967.872663:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788873967.872716:0:17891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788873967.872738:0:17891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9c89f 00000100:00080000:3.0:1788873967.872759:0:17891:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788873967.872766:0:17891:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d33428ea800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873967.872829:0:17891:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343991180 x1875769859159424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873967.872871:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788873967.872920:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859159424:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788873967.872965:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.872968:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.872970:0:17891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788873967.872991:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873967.872996:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.872997:0:17891:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788873967.873001:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000400:00000100:2.0:1788873967.873002:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859159424 offset 0 length 520: 4 00000020:00000080:3.0:1788873967.873015:0:17891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788873967.873018:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.873027:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.873028:0:17891:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788873967.873031:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873967.873033:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.873034:0:17891:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788873967.873038:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788873967.873083:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.873087:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.873088:0:17891:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788873967.873092:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1788873967.873159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873967.873170:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788873967.873173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873967.873185:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788873967.873248:0:17887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788873967.873290:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788873967.873317:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c828 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.873334:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9a00/0x25c660afb0a9c821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c828 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.873343:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3475f37800 from 1 10000000:01000000:0.0:1788873967.873346:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788873967.873379:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.873625:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.873639:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.873666:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873967.873709:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.873738:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34479769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.874024:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859159552 00000100:00100000:3.0:1788873967.874032:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859159552 00000100:00100000:3.0:1788873967.874258:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788873967.874281:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+15:17887:x1875769859159552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873967.874318:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873967.874332:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c8a6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.874379:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 16 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.874390:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 16 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.874399:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873967.874518:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+16:17887:x1875769859159552:12345-0@lo:101:mount.lustre.0 Request processed in 239us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.874535:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788873967.874796:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873967.874814:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.874825:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.877079:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159680:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788873967.877161:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.877335:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34479769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.877486:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859159680 00000100:00100000:3.0:1788873967.877494:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859159680 00000100:00100000:3.0:1788873967.877584:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788873967.877604:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+16:17887:x1875769859159680:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788873967.877625:0:17148:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788873967.877641:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788873967.877645:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788873967.877770:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+16:17887:x1875769859159680:12345-0@lo:256:mount.lustre.0 Request processed in 166us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.877788:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788873967.877868:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159680:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788873967.878519:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788873967.878541:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.878552:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.878610:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3475f37800 from 1 10000000:01000000:0.0:1788873967.878613:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873967.878640:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.878648:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.878657:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.878673:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873967.878706:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.879445:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34479769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.879523:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859159808 00000100:00100000:2.0:1788873967.879530:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859159808 00000100:00100000:2.0:1788873967.879571:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788873967.879580:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+16:17887:x1875769859159808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788873967.879592:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873967.879604:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c8b4 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.879629:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.879640:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.879664:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b2400, rc 0) 00000100:00100000:2.0:1788873967.879721:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859159808:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.879728:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788873967.879876:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873967.879891:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.879901:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873967.880030:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873967.880067:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873967.880098:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.880115:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976000 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.880291:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859159936 00000100:00100000:2.0:1788873967.880296:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859159936 00000100:00100000:2.0:1788873967.880327:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788873967.880334:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859159936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873967.880440:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859159936:12345-0@lo:501:mount.lustre.0 Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.880447:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788873967.880571:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859159936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873967.880598:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788873967.880640:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.880676:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447976000 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.880866:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160064 00000100:00100000:2.0:1788873967.880871:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160064 00000100:00100000:2.0:1788873967.880890:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788873967.880896:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788873967.880981:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160064:12345-0@lo:503:mount.lustre.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.880988:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788873967.881065:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788873967.881458:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873967.881535:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873967.881572:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.881590:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d346075cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.881898:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160192 00000100:00100000:2.0:1788873967.881903:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160192 00000100:00100000:2.0:1788873967.881927:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788873967.881934:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873967.882012:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160192:12345-0@lo:502:mount.lustre.0 Request processed in 78us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.882019:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788873967.882163:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873967.882428:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788873967.882457:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788873967.882472:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788873967.882486:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788873967.882499:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788873967.882513:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788873967.882528:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788873967.882540:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788873967.882551:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788873967.882564:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788873967.882578:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788873967.882601:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873967.882638:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.882665:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d346075cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.882959:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160320 00000100:00100000:2.0:1788873967.882964:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160320 00000100:00100000:2.0:1788873967.883003:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788873967.883012:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873967.883092:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160320:12345-0@lo:502:mount.lustre.0 Request processed in 80us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.883099:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788873967.883196:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873967.883300:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788873967.883445:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788873967.883992:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873967.884001:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884003:0:17900:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788873967.884010:0:17900:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3475f37800 00000020:00000080:3.0:1788873967.884012:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873967.884019:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.884021:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884023:0:17900:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788873967.884025:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873967.884027:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884028:0:17900:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788873967.884031:0:17900:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3475f37800 00000020:00000080:3.0:1788873967.884033:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873967.884091:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.884093:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884095:0:17900:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788873967.884097:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873967.884099:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884100:0:17900:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873967.884103:0:17900:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3475f37800 00000020:00000080:3.0:1788873967.884105:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873967.884121:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.884123:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884125:0:17900:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873967.884127:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873967.884137:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884138:0:17900:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788873967.884142:0:17900:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3475f37800 00000020:00000080:3.0:1788873967.884144:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873967.884163:0:17900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873967.884166:0:17900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873967.884167:0:17900:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788873967.884170:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788873967.887479:0:17887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788873967.887540:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873967.887585:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.887600:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.887684:0:17887:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788873967.887687:0:17887:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3475f37800 10000000:01000000:0.0:1788873967.887691:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3475f37800 10000000:01000000:0.0:1788873967.887695:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873967.887701:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3475f37800 from 1 10000000:01000000:0.0:1788873967.887704:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788873967.887743:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.887752:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.887765:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.887804:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873967.887877:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.887913:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d346075c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.888445:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160448 00000100:00100000:2.0:1788873967.888453:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160448 00000100:00100000:2.0:1788873967.893012:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788873967.893034:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17887:x1875769859160448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788873967.893054:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873967.893074:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33442b3600/0x25c660afb0a9c8c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c8c2 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.893104:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33442b3600/0x25c660afb0a9c8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c8c2 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.893116:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33442b3600/0x25c660afb0a9c8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8c2 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.893125:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b3600, rc 0) 00000100:00100000:2.0:1788873967.894918:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160448:12345-0@lo:101:mount.lustre.0 Request processed in 1884us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.894930:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788873967.896223:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873967.896256:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8c9 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873967.896283:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c8c9 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873967.902466:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788873967.902830:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873967.903087:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788873967.903118:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788873967.903134:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788873967.903151:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788873967.903166:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788873967.903199:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788873967.903246:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788873967.903262:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788873967.903277:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788873967.903293:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788873967.903617:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788873967.903638:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788873967.903655:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788873967.903733:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788873967.903757:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788873967.903899:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788873967.903947:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788873967.903966:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788873967.903980:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788873967.903993:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788873967.904009:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788873967.904026:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788873967.904044:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788873967.904061:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788873967.904079:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788873967.904095:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788873967.904127:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788873967.904144:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788873967.904168:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788873967.904173:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788873967.905454:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873967.905527:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873967.905744:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788873967.906268:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160576 00000100:00100000:1.0:1788873967.906277:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160576 00000100:00100000:1.0:1788873967.906400:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788873967.906412:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873967.906591:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160576:12345-0@lo:501:mount.lustre.0 Request processed in 182us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.906600:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788873967.906659:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873967.907767:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873967.907901:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873967.907938:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.907950:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160704 00000100:00100000:2.0:1788873967.907958:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160704 00000100:00100000:2.0:1788873967.908012:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788873967.908021:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788873967.908137:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160704:12345-0@lo:503:mount.lustre.0 Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.908145:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788873967.908411:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788873967.909604:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788873967.910174:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873967.910858:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873967.910904:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d346075c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.910958:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160832 00000100:00100000:2.0:1788873967.910965:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160832 00000100:00100000:2.0:1788873967.911011:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788873967.911020:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873967.911135:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160832:12345-0@lo:502:mount.lustre.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.911144:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788873967.911191:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873967.911459:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788873967.911518:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788873967.911539:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788873967.911558:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788873967.911578:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788873967.911599:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788873967.911614:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788873967.911628:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788873967.911646:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788873967.911660:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788873967.911671:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788873967.911683:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788873967.911695:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788873967.911707:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788873967.911718:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788873967.912636:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788873967.912674:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788873967.912706:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788873967.912722:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788873967.913870:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788873967.913891:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788873967.913903:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788873967.913916:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788873967.913931:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788873967.913944:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788873967.913955:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788873967.913967:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788873967.913980:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788873967.913993:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788873967.914007:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788873967.914021:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788873967.914035:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788873967.914049:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788873967.914078:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788873967.914101:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788873967.914112:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788873967.914123:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788873967.914134:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788873967.914145:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788873967.914156:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788873967.914170:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788873967.914199:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788873967.914234:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788873967.914249:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788873967.914261:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788873967.914275:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788873967.914288:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788873967.914302:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788873967.914371:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873967.914446:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873967.914496:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654480 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.914532:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859160960 00000100:00100000:2.0:1788873967.914540:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859160960 00000100:00100000:2.0:1788873967.914598:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788873967.914607:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873967.914734:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859160960:12345-0@lo:502:mount.lustre.0 Request processed in 127us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.914742:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788873967.915420:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859160960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873967.915633:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788873967.915658:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788873967.915686:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859161088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873967.917065:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873967.917127:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161088 00000100:00100000:1.0:1788873967.917130:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654480 going to sleep for 11 seconds 00000100:00100000:2.0:1788873967.917137:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161088 00000100:00100000:2.0:1788873967.917246:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788873967.917258:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859161088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873967.917426:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859161088:12345-0@lo:502:mount.lustre.0 Request processed in 170us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.917435:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788873967.917490:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859161088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873967.917568:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1788873967.917582:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788873967.920820:0:17906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788873967.920843:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9d347a8c8000) 00000020:00000080:2.0:1788873967.920871:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788873967.920946:0:17906:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3475f37800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788873967.920951:0:17906:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3475f37800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788873967.920954:0:17906:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3475f37800 3 00010000:00080000:2.0:1788873967.920983:0:17906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d334397a000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.120@tcp at head 00010000:00010000:2.0:1788873967.922726:0:17906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788873967.922933:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788873967.922976:0:17906:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788873967.922990:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x25c660afb0a9c8d7 00000100:00080000:2.0:1788873967.923000:0:17906:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788873967.923006:0:17906:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d334397a000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788873967.923042:0:17906:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a726680 x1875769859161216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873967.923069:0:17906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788873967.923172:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769859161216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788873967.923272:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873967.923369:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161216 00000100:00100000:1.0:1788873967.923377:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161216 00000100:00080000:0.0:1788873967.926093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873967.926098:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788873967.926101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873967.926104:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788873967.926139:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788873967.926153:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769859161216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788873967.926193:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788873967.926248:0:17157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x25c660afb0a9c8de 00000004:00100000:0.0:1788873967.926263:0:17157:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788873967.926296:0:17157:0:(import.c:65:import_set_state_nolock()) ffff9d3480d47800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873967.926385:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875769859161216:12345-0@lo:38:llog_process_th.0 Request processed in 231us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873967.926392:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788873967.927746:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d347a726680 x1875769859161216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873967.927760:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788873967.927769:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788873967.927777:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788873967.927783:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788873967.927785:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d334397a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788873967.927793:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875769859161216:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788873967.928373:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788873967.929247:0:17887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788873967.929294:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788873967.929437:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8c9 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.929450:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9600/0x25c660afb0a9c8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8c9 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788873967.929533:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788873967.929536:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788873967.929537:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873967.929538:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873967.929539:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873967.929545:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873967.929546:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788873967.929548:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873967.929549:0:17887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788873967.929552:0:17887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788873967.929555:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788873967.929556:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788873967.929557:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873967.929558:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873967.929559:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873967.929560:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873967.929561:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788873967.929562:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873967.929563:0:17887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788873967.929587:0:17887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788873967.929603:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859161344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788873967.929658:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873967.929698:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161344 00000100:00100000:2.0:1788873967.929702:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34504ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873967.929705:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161344 00000100:00100000:3.0:1788873967.930096:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788873967.930108:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859161344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788873967.930138:0:17150:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788873967.930152:0:17150:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788873967.932749:0:17135:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788873967.932960:0:17150:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788873967.932973:0:17150:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788873967.932989:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788873967.932994:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788873967.933012:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933026:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933032:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933037:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933069:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933079:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.933088:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859161472:0@lo:104: 00000100:00100000:0.0:1788873967.933147:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788873967.933201:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873967.933280:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161472 00000100:00100000:2.0:1788873967.933287:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161472 00000100:00100000:2.0:1788873967.933338:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873967.933349:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859161472:12345-0@lo:104: 00010000:00010000:0.0:1788873967.933354:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 18 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.933364:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.933366:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859161600:0@lo:104: 00000100:00100000:0.0:1788873967.933394:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.933409:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d96cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788873967.933421:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788873967.933428:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859161472:12345-0@lo:104: Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873967.933436:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873967.933449:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161600 00000100:00100000:2.0:1788873967.933452:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161600 00000100:00100000:2.0:1788873967.933463:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873967.933474:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859161600:12345-0@lo:104: 00000100:00100000:0.0:1788873967.933481:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859161472:0@lo:104: 00010000:00010000:2.0:1788873967.933494:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.933536:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788873967.933541:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788873967.933543:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859161600:12345-0@lo:104: Request processed in 68us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1788873967.933547:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873967.933553:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788873967.933559:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad9c00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873967.933562:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873967.933574:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873967.933575:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873967.933582:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873967.933586:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788873967.933616:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933622:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873967.933647:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933655:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9c00/0x25c660afb0a9c8a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8ad expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933666:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873967.933668:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873967.933670:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873967.933680:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859161728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873967.933700:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873967.933737:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161728 00000100:00100000:3.0:1788873967.933780:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17887:x1875769859161344:12345-0@lo:253:mount.lustre.0 Request processed in 3673us (4119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.933788:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788873967.933863:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161728 00010000:00010000:0.0:1788873967.933881:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873967.933898:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873967.933903:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+18:3634:x1875769859161728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873967.933910:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873967.933913:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933921:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933930:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c8ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c8a6 expref: 18 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.933937:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873967.933957:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+17:3634:x1875769859161728:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873967.933966:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873967.933987:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859161728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873967.934007:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859161600:0@lo:104: 00010000:00010000:0.0:1788873967.934017:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873967.934118:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:17887:1875769859161344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788873967.934129:0:17887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788873967.934132:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788873967.934134:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788873967.934136:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873967.934137:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873967.934140:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873967.934141:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873967.934143:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788873967.934146:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873967.934147:0:17887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788873967.934160:0:17887:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788873967.934291:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873967.934294:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873967.934296:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873967.934393:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934402:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873967.934412:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934420:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873967.934428:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873967.934434:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788873967.934464:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934471:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873967.934488:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934495:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d33442b3e00/0x25c660afb0a9c7e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7e9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934510:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873967.934512:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873967.934514:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873967.934525:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859161856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873967.934561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873967.934601:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161856 00000100:00100000:3.0:1788873967.934606:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161856 00010000:00010000:3.0:1788873967.934623:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 17 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873967.934646:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788873967.934662:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+17:3635:x1875769859161856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788873967.934671:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873967.934676:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 17 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934688:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 17 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934700:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475eca600/0x25c660afb0a9c7e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c7e2 expref: 17 pid: 17149 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934713:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934720:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788873967.934732:0:17142:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006491093s 00010000:00010000:3.0:1788873967.934736:0:17142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934743:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934750:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934756:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934761:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8c00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873967.934772:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934780:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934792:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873967.934801:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873967.934831:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+16:3635:x1875769859161856:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.934837:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788873967.934863:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859161856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873967.935079:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.935086:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873967.935090:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3343ad8c00/0x25c660afb0a9c8e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788873967.943276:0:17912:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000040:01000000:3.0:1788873967.943279:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788873967.943284:0:17912:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788873967.943520:0:17913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788873967.943572:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1788873967.944008:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788873967.944036:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873967.944357:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873967.944432:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1875769859161984:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.944508:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873967.944547:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873967.944898:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859161984 00000100:00100000:1.0:1788873967.944904:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859161984 00000100:00100000:1.0:1788873967.944937:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873967.944943:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17914:x1875769859161984:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788873967.945008:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17914:x1875769859161984:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 63us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.945015:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788873967.945042:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1875769859161984:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788873967.945072:0:17914:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788873967.945097:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1875769859162112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.945124:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873967.945148:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873967.945202:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162112 00000100:00100000:1.0:1788873967.945225:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162112 00000100:00100000:1.0:1788873967.945252:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873967.945258:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17914:x1875769859162112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788873967.945348:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17914:x1875769859162112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.945355:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788873967.945474:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1875769859162112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.945627:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17914:1875769859162240:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.945653:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873967.945716:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162240 00000100:00100000:3.0:1788873967.945721:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162240 00000100:00100000:3.0:1788873967.945744:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873967.945750:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17914:x1875769859162240:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.945783:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17914:x1875769859162240:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873967.945789:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873967.945806:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8a540 going to sleep for 11 seconds 00010000:00080000:3.0:1788873967.945844:0:17914:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3343992d80 x1875769859162240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788873983 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873967.945854:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17914:1875769859162240:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.945887:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1875769859162368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788873967.945911:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873967.945933:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873967.946224:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162368 00000100:00100000:1.0:1788873967.946229:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162368 00000100:00100000:1.0:1788873967.946253:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873967.946259:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17914:x1875769859162368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788873967.946317:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17914:x1875769859162368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 57us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873967.946323:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873967.946473:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1875769859162368:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788873967.946517:0:17914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788873967.946680:0:17887:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788873967.946689:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788873967.946756:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873967.949804:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788873967.951632:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788873967.951701:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788873967.952031:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873967.952154:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788873967.952247:0:17913:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1788873967.952729:0:17887:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1788873967.954897:0:17887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788873967.956504:0:17887:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788873967.956541:0:17887:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbcd1819d7988 00100000:10000000:2.0:1788873967.956550:0:17887:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788873967.957051:0:17887:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788873967.957084:0:17887:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788873967.957100:0:17887:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788873967.957114:0:17887:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1788873967.957718:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788873967.957797:0:17914:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788873967.957802:0:17914:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:2.0:1788873967.957967:0:17887:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873967.958154:0:17887:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788873968.242240:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:1.0:1788873968.755608:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788873968.943107:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788873969.268414:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 10000000:01000000:1.0:1788873969.582336:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788873969.582354:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3475f37800 from 8 10000000:01000000:1.0:1788873969.582360:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788873969.582408:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873969.582421:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873969.582433:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873969.582460:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873969.582533:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873969.582587:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788873969.582665:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162496 00000100:00100000:0.0:1788873969.582673:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162496 00000100:00100000:0.0:1788873969.582734:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788873969.582747:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+16:17152:x1875769859162496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873969.582761:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873969.582776:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c8ec expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873969.582800:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873969.582825:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873969.582834:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9c00, rc 0) 00000100:00100000:0.0:1788873969.582887:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859162496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873969.582893:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788873969.582942:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873969.582969:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873969.582980:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873969.583038:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788873969.583071:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873969.583106:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873969.583150:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162624 00000100:00100000:0.0:1788873969.583156:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162624 00000100:00100000:0.0:1788873969.583200:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788873969.583253:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859162624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788873969.583269:0:17150:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788873969.583284:0:17150:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788873969.583288:0:17150:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788873969.583378:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859162624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873969.583385:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788873969.583443:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788873969.583489:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873969.583496:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873969.583506:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873969.583516:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788873969.583518:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3442ab2000 from 8 10000000:01000000:3.0:1788873969.583520:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788873969.583536:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873969.583544:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873969.583551:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873969.583562:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873969.583586:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873969.583617:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873969.583788:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162752 00000100:00100000:1.0:1788873969.583793:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162752 00000100:00100000:1.0:1788873969.583833:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788873969.583840:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859162752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873969.583849:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873969.583858:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c8fa expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873969.583873:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873969.583883:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873969.583891:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecba00, rc 0) 00000100:00100000:1.0:1788873969.583932:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859162752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873969.583945:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788873969.584022:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873969.584041:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873969.584049:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873969.584101:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788873969.584129:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873969.584154:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788873969.584235:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859162880 00000100:00100000:1.0:1788873969.584240:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859162880 00000100:00100000:1.0:1788873969.584271:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788873969.584278:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859162880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788873969.584291:0:17148:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788873969.584303:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788873969.584307:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788873969.584372:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859162880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873969.584379:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788873969.584466:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859162880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788873969.584503:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873969.584510:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873969.584518:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873969.777682:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788873969.967436:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788873970.287407:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:0.0:1788873970.799715:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873971.310594:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00010000:00010000:0.0:1788873971.823158:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873972.339772:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 0 seconds 00000001:02000400:1.0:1788873972.481896:0:18155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788873972.846422:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873972.974471:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873972.974496:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859163008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873972.974583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873972.974746:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163008 00000100:00100000:1.0:1788873972.974754:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163008 00000100:00100000:1.0:1788873972.974810:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788873972.974823:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859163008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873972.974860:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788873972.974922:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859163008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873972.974931:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788873972.974992:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859163008:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788873972.976769:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788873972.976776:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788873972.976779:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788873972.976791:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d3445e97800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873972.976792:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859163136:0@lo:400:kworker.0 00000100:00100000:2.0:1788873972.976812:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347a725180 x1875769859163264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788873972.976828:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873972.976832:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873972.976836:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873972.976839:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788873972.976854:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788873972.976861:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873972.976866:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873972.976868:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873972.976872:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788873972.976913:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873972.976921:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859163392:0@lo:400:kworker.0 00000100:00100000:2.0:1788873972.976931:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859163264:0@lo:38:kworker.0 00000100:00100000:1.0:1788873972.976958:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873972.976989:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163136 00000100:00100000:1.0:1788873972.976996:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163136 00000100:00100000:1.0:1788873972.977042:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788873972.977052:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:3633:x1875769859163136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873972.977096:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:3633:x1875769859163136:12345-0@lo:400:kworker.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873972.977105:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788873972.977149:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163392 00000100:00100000:1.0:1788873972.977154:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163392 00000100:00100000:1.0:1788873972.977193:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788873972.977200:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859163392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873972.977257:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859163392:12345-0@lo:400:kworker.0 Request processed in 58us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873972.977264:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788873972.977301:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d347a727480 x1875769859163392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873972.977313:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859163392:0@lo:400:kworker.0 00000100:00100000:1.0:1788873972.977323:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859163136:0@lo:400:kworker.0 00000100:00100000:2.0:1788873972.977711:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873972.977752:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873972.977759:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163264 00000100:00100000:2.0:1788873972.977763:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859163520:0@lo:400:kworker.0 00000100:00100000:1.0:1788873972.977765:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163264 00000100:00100000:2.0:1788873972.977800:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873972.977800:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788873972.977811:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1875769859163264:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788873972.977838:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163520 00010000:00080000:1.0:1788873972.977841:0:17160:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000100:00100000:2.0:1788873972.977844:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163520 00000100:00100000:2.0:1788873972.977873:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788873972.977881:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859163520:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1788873972.977892:0:17160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9c908 00000004:00100000:1.0:1788873972.977911:0:17160:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788873972.977918:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859163520:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000001:00000004:1.0:1788873972.977918:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788873972.977928:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788873972.977953:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d347a725500 x1875769859163520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873972.980149:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859163520:0@lo:400:kworker.0 00000100:00080000:2.0:1788873972.989405:0:17160:0:(import.c:65:import_set_state_nolock()) ffff9d33435fa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873972.989501:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875769859163264:12345-0@lo:38:kworker.0 Request processed in 11690us (11789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873972.989513:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788873972.989621:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788873972.989631:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788873972.989636:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788873972.989638:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3445e97800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788873972.989658:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fa384371): req@ffff9d347a724000 x1875769859156224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873972.989679:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859163264:0@lo:38:kworker.0 00000100:00100000:0.0:1788873972.989977:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859163648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873972.990019:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873972.990234:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163648 00000100:00100000:1.0:1788873972.990242:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163648 00000100:00100000:1.0:1788873972.990285:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788873972.990295:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859163648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873972.990323:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788873972.990366:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859163648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873972.990373:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788873972.990405:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859163648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873972.990805:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873972.990843:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58000 going to sleep for 11 seconds 00000100:00100000:0.0:1788873972.990908:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859156224 00000100:00100000:0.0:1788873972.990912:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859156224 00000100:00100000:0.0:1788873972.990934:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788873972.990940:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17197:x1875769859156224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788873972.991019:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17197:x1875769859156224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873972.991025:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788873972.991240:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1875769859156224:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788873972.991274:0:17197:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788873972.991306:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1875769859163776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788873972.991335:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873972.991357:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34462dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788873972.991466:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163776 00000100:00100000:1.0:1788873972.991470:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163776 00000100:00100000:1.0:1788873972.991487:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788873972.991492:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1875769859163776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788873972.991591:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1875769859163776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873972.991597:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873972.991689:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1875769859163776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788873972.991750:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1875769859163904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788873972.991772:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873972.991791:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451608180 going to sleep for 11 seconds 00000100:00100000:1.0:1788873972.991834:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859163904 00000100:00100000:1.0:1788873972.991837:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859163904 00000100:00100000:1.0:1788873972.991864:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873972.991870:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1875769859163904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788873972.991937:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1875769859163904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873972.991944:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788873972.992094:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1875769859163904:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788873972.992139:0:17197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873972.999006:0:17197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788873973.002703:0:17197:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788873973.002712:0:17197:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788873973.552095:0:18208:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873973.552937:0:18208:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873973.871772:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788873974.557003:0:18259:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788873974.557471:0:18259:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788873974.895484:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788873975.621931:0:18308:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdada05fd0 20000000:00000080:0.0:1788873975.621951:0:18308:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347ce34000 uarg=0000000000000000 20000000:01000000:0.0:1788873975.621994:0:18308:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788873975.622002:0:18308:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788873975.622007:0:18308:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788873975.622698:0:18309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788873975.622868:0:18308:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788873975.633927:0:18308:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788873975.634014:0:18308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.634038:0:18308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.634047:0:18308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.634056:0:18308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.634120:0:18308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.634140:0:18308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 17 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873975.634159:0:18308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18308:1875769859164032:0@lo:104: 00000100:00100000:1.0:1788873975.634273:0:18308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873975.634328:0:18308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.634336:0:18308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 17 pid: 17148 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873975.634345:0:18308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18308:1875769859164160:0@lo:104: 00000100:00100000:1.0:1788873975.634363:0:18308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873975.634409:0:18308:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34584a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788873975.634544:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164032 00000100:00100000:3.0:1788873975.634554:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164032 00000100:00100000:3.0:1788873975.634601:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164160 00000100:00100000:3.0:1788873975.634603:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164160 00000100:00100000:3.0:1788873975.634629:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873975.634638:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+4:18308:x1875769859164032:12345-0@lo:104: 00010000:00010000:3.0:1788873975.634651:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634747:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788873975.634754:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+4:18308:x1875769859164032:12345-0@lo:104: Request processed in 117us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873975.634761:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873975.634789:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873975.634796:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:18308:x1875769859164160:12345-0@lo:104: 00010000:00010000:3.0:1788873975.634804:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634837:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788873975.634842:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:18308:x1875769859164160:12345-0@lo:104: Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873975.634848:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788873975.634864:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788873975.634869:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634876:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873975.634880:0:17909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634889:0:17909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873975.634896:0:17909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873975.634902:0:17909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788873975.634939:0:17909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634946:0:17909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873975.634965:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634972:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8400/0x25c660afb0a9c8b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8bb expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634985:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788873975.634988:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.634993:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:3.0:1788873975.634996:0:17909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635002:0:17909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788873975.635008:0:17909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873975.635013:0:17909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788873975.635027:0:17909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635032:0:17909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788873975.635038:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635055:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475eca400/0x25c660afb0a9c7b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c7b8 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635066:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873975.635068:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873975.635070:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873975.635077:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873975.635095:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859164288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873975.635136:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873975.635158:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873975.635164:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859164416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873975.635183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873975.635241:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164288 00000100:00100000:3.0:1788873975.635246:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164288 00010000:00010000:3.0:1788873975.635265:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 18 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873975.635286:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164416 00000100:00100000:3.0:1788873975.635289:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164416 00010000:00010000:3.0:1788873975.635300:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 19 pid: 17148 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873975.635314:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873975.635320:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+19:3633:x1875769859164288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788873975.635331:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873975.635336:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 19 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635356:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 19 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635369:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873975.635809:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+19:3633:x1875769859164288:12345-0@lo:103:ldlm_bl.0 Request processed in 487us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873975.635817:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788873975.635833:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873975.635840:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+18:3633:x1875769859164416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788873975.635848:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873975.635853:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 18 pid: 17148 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635862:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 18 pid: 17148 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635873:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635880:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635892:0:17142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635899:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635906:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635918:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635924:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873975.635928:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635935:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635944:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873975.635953:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873975.635978:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+18:3633:x1875769859164416:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873975.635984:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788873975.636412:0:18308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d33442b2400/0x25c660afb0a9c8bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c8b4 expref: 17 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873975.636425:0:18308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18308:1875769859164032:0@lo:104: 00010000:00010000:1.0:1788873975.636435:0:18308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c7b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c7b1 expref: 16 pid: 17148 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873975.636441:0:18308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18308:1875769859164160:0@lo:104: 00010000:00010000:1.0:1788873975.636620:0:18308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.636630:0:18308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.636636:0:18308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873975.636643:0:18308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475ecbc00/0x25c660afb0a9c90f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873975.641067:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859164288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788873975.641361:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859164416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873975.919730:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873976.943490:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788873977.070790:0:17152:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788873977.070807:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3475f37800 from 13 10000000:01000000:0.0:1788873977.070814:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788873977.070865:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873977.070875:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873977.070895:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873977.070921:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859164544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788873977.071184:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873977.071253:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873977.072101:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164544 00000100:00100000:3.0:1788873977.072110:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164544 00000100:00100000:3.0:1788873977.072184:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788873977.072195:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+16:17152:x1875769859164544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788873977.072231:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873977.072248:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c916 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873977.072273:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873977.072315:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873977.072325:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788873977.072385:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859164544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873977.072392:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788873977.072712:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873967/real 1788873967] req@ffff9d3343991180 x1875769859159424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873977 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873977.072734:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343991180 x1875769859159424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873977 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873977.072745:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873967/real 1788873967] req@ffff9d3343992a00 x1875769859159168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873977 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873977.072756:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343992a00 x1875769859159168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873977 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873977.072785:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788873977.072800:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788873977.072804:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859159424:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788873977.072810:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d34505d4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788873977.072814:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788873977.072817:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859159168:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788873977.072916:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859164544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873977.072932:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873977.072942:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873977.073010:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859164672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873977.073042:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873977.073079:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873977.073139:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164672 00000100:00100000:2.0:1788873977.073143:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164672 00000100:00100000:2.0:1788873977.073177:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788873977.073185:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859164672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00080000:3.0:1788873977.073472:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873977.073477:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873977.073480:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873977.073482:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873977.073504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873977.073508:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788873977.073510:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d34505d4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873977.073516:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788873977.073520:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788873977.073525:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d34505d4800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873977.073543:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343992680 x1875769859165184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788873977.073557:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873977.073560:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788873977.073561:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873977.073564:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788873977.073574:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788873977.073578:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d33428ea800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873977.073590:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343993100 x1875769859165312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873977.073622:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859164928:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.073661:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873977.073691:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788873977.073697:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859164800:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.073722:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873977.073748:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859165056:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.073770:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873977.073790:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873977.073796:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859165440:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.073815:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873977.073844:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164928 00000100:00100000:3.0:1788873977.073848:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164928 00000100:00100000:3.0:1788873977.073875:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859165440 00000100:00100000:3.0:1788873977.073878:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859165440 00000100:00100000:3.0:1788873977.073890:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873977.073897:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859164928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.073935:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875769859164928:12345-0@lo:400:kworker.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873977.073943:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788873977.073959:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873977.073964:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859165440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.073996:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859165440:12345-0@lo:400:kworker.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873977.074007:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873977.074026:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859164800 00000100:00100000:3.0:1788873977.074030:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859164800 00000100:00100000:3.0:1788873977.074045:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859165056 00000100:00100000:3.0:1788873977.074047:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859165056 00000100:00100000:3.0:1788873977.074057:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873977.074063:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859164800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.074110:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859164800:12345-0@lo:400:kworker.0 Request processed in 46us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873977.074116:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788873977.074128:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788873977.074134:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859165056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.074160:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859165056:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873977.074165:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788873977.074197:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3343992a00 x1875769859165440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873977.074233:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859165440:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.074245:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859165056:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.074273:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859164800:0@lo:400:kworker.0 00010000:00080000:3.0:1788873977.074282:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3343991500 x1875769859164928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873977.074288:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875769859164928:0@lo:400:kworker.0 00000100:00100000:3.0:1788873977.074319:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859165184:0@lo:8:kworker.0 00000400:00000100:3.0:1788873977.074348:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859165184 offset 0 length 520: 4 00000100:00100000:3.0:1788873977.074371:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859165312:0@lo:8:kworker.0 00000400:00000100:3.0:1788873977.074388:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859165312 offset 0 length 520: 4 00000100:00100000:2.0:1788873977.074575:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859164672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1389us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873977.074583:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788873977.076596:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859164672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788873977.076666:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873977.076731:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873977.076814:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480e60900 going to sleep for 11 seconds 00000100:00100000:0.0:1788873977.077532:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859165568 00000100:00100000:0.0:1788873977.077541:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859165568 00000100:00100000:0.0:1788873977.077592:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788873977.077603:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859165568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873977.077732:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859165568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873977.077740:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788873977.077765:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788873977.079119:0:18374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788873977.079450:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788873977.079486:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788873977.079502:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873977.079516:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873977.079527:0:17152:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788873977.079530:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3442ab2000 from 13 10000000:01000000:3.0:1788873977.079532:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788873977.079578:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873977.079585:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873977.079595:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873977.079630:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873977.079704:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873977.079756:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480e60900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873977.080075:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859165696 00000100:00100000:1.0:1788873977.080083:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859165696 00000100:00100000:1.0:1788873977.080135:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788873977.080145:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+17:17152:x1875769859165696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873977.080157:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873977.080170:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c924 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873977.080236:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873977.080251:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873977.080262:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca200, rc 0) 00000100:00100000:1.0:1788873977.080415:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859165696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873977.080423:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788873977.080443:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873977.080458:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873977.080472:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873977.080520:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873977.080551:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873977.080617:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859165824 00000100:00100000:1.0:1788873977.080622:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859165824 00000100:00100000:0.0:1788873977.080641:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873977.080661:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788873977.080669:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859165824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788873977.080788:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859165824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873977.080795:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788873977.080850:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788873977.080875:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788873977.080912:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873977.080932:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488900 going to sleep for 11 seconds 00000100:00100000:3.0:1788873977.080970:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859165952 00000100:00100000:3.0:1788873977.080975:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859165952 00000100:00100000:3.0:1788873977.081008:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788873977.081017:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859165952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788873977.081118:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:17152:x1875769859165952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873977.081127:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788873977.081132:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859165952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788873977.084775:0:18375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788873977.085548:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788873977.085572:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873977.085594:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873977.085606:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873977.394111:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788873977.966430:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873978.094815:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859166080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873978.094894:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873978.094962:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873978.094969:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859166208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873978.094992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873978.095022:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859166080 00000100:00100000:1.0:1788873978.095030:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859166080 00000100:00100000:1.0:1788873978.095064:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859166208 00000100:00100000:1.0:1788873978.095067:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859166208 00000100:00100000:1.0:1788873978.095092:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788873978.095101:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875769859166080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873978.095149:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788873978.095196:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875769859166080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873978.095222:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788873978.095241:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788873978.095248:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859166208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788873978.095265:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788873978.095305:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859166208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873978.095312:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788873978.095354:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859166208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873978.095379:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859166080:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788873978.990555:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788873979.123770:0:17888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788873979.184168:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788873980.015446:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873980.143401:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873965/real 1788873965] req@ffff9d347a724700 x1875769859157248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873980.143431:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347a724700 x1875769859157248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873980.143442:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873965/real 1788873965] req@ffff9d347a727b80 x1875769859157376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873980.143452:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347a727b80 x1875769859157376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788873980.143470:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788873980.143517:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788873980.143521:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859157248:0@lo:8:kworker.0 00000100:00080000:3.0:1788873980.143539:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788873980.146902:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859166336:0@lo:400:kworker.0 00000100:00100000:0.0:1788873980.146971:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873980.148285:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859166336 00000100:00100000:2.0:1788873980.148297:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859166336 00000100:00100000:2.0:1788873980.148350:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788873980.148360:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:3633:x1875769859166336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788873980.148694:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788873980.148710:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859157376:0@lo:8:kworker.0 00000100:00080000:1.0:1788873980.149301:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873980.149308:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788873980.149311:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788873980.149316:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1788873980.149330:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788873980.149336:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3343a88800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873980.149362:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f357b80 x1875769859166592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873980.149386:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873980.149389:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788873980.149391:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788873980.149394:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1788873980.149397:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788873980.149400:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3342b91800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873980.149411:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f356680 x1875769859166720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873980.149443:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873980.149446:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873980.149448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873980.149451:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873980.149466:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873980.149469:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873980.149471:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873980.149473:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788873980.149491:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859166464:0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.149537:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873980.149585:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873980.149591:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859167104:0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.149614:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873980.149638:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859166848:0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.149677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873980.149811:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859166592:0@lo:8:kworker.0 00000400:00000100:3.0:1788873980.149840:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859166592 offset 0 length 520: 4 00000100:00100000:3.0:1788873980.149869:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859166720:0@lo:8:kworker.0 00000400:00000100:3.0:1788873980.149888:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875769859166720 offset 0 length 520: 4 00000100:00100000:1.0:1788873980.150046:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873980.150053:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859166976:0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150088:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873980.150128:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859166464 00000100:00100000:1.0:1788873980.150135:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859166464 00000100:00100000:1.0:1788873980.150164:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859166976 00000100:00100000:1.0:1788873980.150167:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859166976 00000100:00100000:1.0:1788873980.150181:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873980.150189:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859166464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150263:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859166464:12345-0@lo:400:kworker.0 Request processed in 74us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873980.150271:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788873980.150287:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788873980.150294:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859166976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150324:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859166976:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873980.150330:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788873980.150348:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167104 00000100:00100000:1.0:1788873980.150351:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167104 00000100:00100000:1.0:1788873980.150372:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859166848 00000100:00100000:1.0:1788873980.150375:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859166848 00000100:00100000:1.0:1788873980.150386:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873980.150391:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859167104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150430:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859167104:12345-0@lo:400:kworker.0 Request processed in 39us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873980.150435:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873980.150445:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873980.150451:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859166848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150474:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859166848:12345-0@lo:400:kworker.0 Request processed in 24us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873980.150480:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788873980.150513:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d347f357800 x1875769859167104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873980.150531:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859167104:0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150543:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859166464:0@lo:400:kworker.0 00000100:00100000:1.0:1788873980.150636:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859166976:0@lo:400:kworker.0 00010000:00080000:1.0:1788873980.150762:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d347f355c00 x1875769859166848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873980.150775:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859166848:0@lo:400:kworker.0 00000100:00100000:2.0:1788873980.155478:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:3633:x1875769859166336:12345-0@lo:400:kworker.0 Request processed in 7111us (8498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873980.155493:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788873980.156382:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859166336:0@lo:400:kworker.0 00010000:00010000:3.0:1788873981.038368:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788873981.628079:0:18655:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788873981.628084:0:18655:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788873981.628085:0:18655:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788873981.628197:0:18655:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3480d47000 00000020:01000004:0.0:1788873981.628246:0:18655:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788873981.628260:0:18655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788873981.628274:0:18655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d34584a99c0) 00000020:00000080:0.0:1788873981.628288:0:18655:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788873981.698185:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788873981.711918:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788873981.712692:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788873981.713454:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788873981.717031:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788873981.718347:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788873981.719847:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788873981.722035:0:18655:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788873981.722321:0:18655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788873981.722335:0:18655:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788873981.722347:0:18655:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c660afb0a9c939 00000020:01000004:1.0:1788873981.722423:0:18655:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788873981.722449:0:18655:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788873981.722452:0:18655:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788873981.722458:0:18655:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788873981.722463:0:18655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788873981.722475:0:18655:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d3475d819c0) 00000020:00000080:1.0:1788873981.722488:0:18655:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788873981.724254:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873981.724815:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788873981.724824:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788873981.731998:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788873981.732012:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788873981.735903:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788873981.735914:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788873981.737636:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788873981.737932:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788873981.737937:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788873981.744962:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788873981.744977:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788873981.771414:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873981.772043:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788873981.772073:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788873981.774182:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788873981.774196:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788873981.775662:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788873981.775676:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788873981.779842:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788873981.780075:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788873981.780084:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788873981.781178:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788873981.781189:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788873981.840110:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788873981.840493:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788873981.840504:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788873981.842440:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788873981.842455:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788873981.843387:0:18655:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788873981.843423:0:18655:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788873981.843431:0:18655:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788873981.860134:0:18655:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788873981.860177:0:18655:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.120@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788873981.860182:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788873981.860184:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788873981.860186:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873981.860187:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873981.860188:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873981.860194:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873981.860196:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873981.860197:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873981.860198:0:18655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788873981.860288:0:18655:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788873981.860292:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788873981.860293:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788873981.860294:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873981.860295:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873981.860296:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873981.860297:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873981.860298:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873981.860299:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873981.860300:0:18655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788873981.860342:0:18655:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788873981.860367:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788873981.860448:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873981.860515:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3447978c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.860649:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167232 00000100:00100000:1.0:1788873981.860656:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167232 00000100:00100000:1.0:1788873981.860875:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788873981.860885:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:18655:x1875769859167232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788873981.860917:0:17148:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788873981.860921:0:17148:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788873981.860925:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788873981.861425:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+18:18655:x1875769859167232:12345-0@lo:253:mount.lustre.0 Request processed in 540us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.861434:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788873981.861517:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788873981.861530:0:18655:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788873981.861532:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788873981.861644:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788873981.861645:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873981.861647:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873981.861648:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873981.861649:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873981.861650:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873981.861652:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873981.861653:0:18655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788873981.861676:0:18655:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3480d47000 from lustre-OST0000 10000000:01000000:3.0:1788873981.861805:0:18655:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788873981.861809:0:18655:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788873981.861817:0:18655:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3342964d40 local copy 00010000:00010000:3.0:1788873981.861827:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873981.861950:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873981.861986:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873981.862076:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3442b84f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788873981.862146:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167360 00000100:00100000:2.0:1788873981.862152:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167360 00000100:00100000:2.0:1788873981.862258:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788873981.862269:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:18655:x1875769859167360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873981.862352:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+18:18655:x1875769859167360:12345-0@lo:501:mount.lustre.0 Request processed in 85us (365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788873981.862360:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788873981.862435:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167360:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788873981.862450:0:18655:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788873981.862474:0:18655:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788873981.862481:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.862491:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873981.862520:0:18655:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3480d47000 10000000:01000000:0.0:1788873981.862525:0:18655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788873981.862530:0:18655:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788873981.862533:0:18655:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873981.862551:0:18655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788873981.862554:0:18655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788873981.862580:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.862589:0:18655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.862598:0:18655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873981.862612:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873981.862649:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.862968:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480e60840 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.863068:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167488 00000100:00100000:3.0:1788873981.863073:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167488 00000100:00100000:3.0:1788873981.863100:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788873981.863106:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+18:18655:x1875769859167488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873981.863115:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873981.863128:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c94e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c947 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873981.863150:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c94e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c947 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873981.863162:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442a00/0x25c660afb0a9c94e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c947 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873981.863171:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442a00, rc 0) 00000100:00100000:3.0:1788873981.863230:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167488:12345-0@lo:101:mount.lustre.0 Request processed in 124us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.863237:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788873981.863313:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873981.863327:0:18655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c94e expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.863336:0:18655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c94e expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788873981.864651:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788873981.865396:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788873981.868034:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788873981.868107:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788873981.868124:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788873981.868138:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788873981.868151:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788873981.868164:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788873981.868346:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788873981.868355:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788873981.868461:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873981.868902:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.868958:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480e60a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.869011:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167616 00000100:00100000:3.0:1788873981.869020:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167616 00000100:00100000:3.0:1788873981.869080:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788873981.869091:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873981.869283:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167616:12345-0@lo:501:mount.lustre.0 Request processed in 193us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.869301:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788873981.869397:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873981.869436:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788873981.869479:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873981.869510:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34505ab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.869663:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167744 00000100:00100000:3.0:1788873981.869668:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167744 00000100:00100000:3.0:1788873981.869698:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788873981.869704:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873981.870976:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167744:12345-0@lo:503:mount.lustre.0 Request processed in 1264us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.870989:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788873981.871124:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167744:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788873981.872158:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873981.872435:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873981.872520:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.872717:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480e60000 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.872896:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859167872 00000100:00100000:3.0:1788873981.872903:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859167872 00000100:00100000:3.0:1788873981.873014:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788873981.873025:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873981.873525:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859167872:12345-0@lo:502:mount.lustre.0 Request processed in 501us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.873543:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788873981.873692:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859167872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873981.874081:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788873981.874114:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788873981.874126:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788873981.874137:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788873981.874147:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788873981.874157:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788873981.874168:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788873981.874178:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788873981.874234:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788873981.874250:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788873981.874261:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788873981.874272:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788873981.874300:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.874342:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.874506:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33438e2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788873981.874822:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168000 00000100:00100000:0.0:1788873981.874831:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168000 00000100:00100000:0.0:1788873981.874873:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788873981.874892:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859168000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873981.875008:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859168000:12345-0@lo:502:mount.lustre.0 Request processed in 118us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.875016:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788873981.875119:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873981.875171:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788873981.875180:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788873981.876522:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788873981.876533:0:18673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788873981.876651:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.876654:0:18673:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788873981.876664:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788873981.876790:0:18673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d3480da0000) 00000020:00000080:3.0:1788873981.876834:0:18673:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788873981.876843:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788873981.876926:0:18673:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3480d47000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788873981.876934:0:18673:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788873981.876941:0:18673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c660afb0a9c95c 00010000:00010000:3.0:1788873981.882495:0:18673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788873981.883428:0:18673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788873981.885526:0:18673:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788873981.887692:0:18673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788873981.887705:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873981.887711:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.887713:0:18673:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788873981.887717:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788873981.887821:0:18673:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788873981.887824:0:18673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873981.887826:0:18673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788873981.887827:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788873981.887831:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.887832:0:18673:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788873981.887835:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873981.887838:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.887839:0:18673:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788873981.887842:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788873981.887844:0:18673:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788873981.887846:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873981.887848:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.887850:0:18673:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788873981.887852:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873981.887853:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.887855:0:18673:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788873981.887857:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788873981.887887:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873981.887889:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873981.887890:0:18673:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788873981.887893:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788873981.891890:0:18655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788873981.891947:0:18655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788873981.891976:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c94e expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.891990:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9400/0x25c660afb0a9c947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c94e expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873981.892000:0:18655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3480d47000 from 1 10000000:01000000:1.0:1788873981.892003:0:18655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788873981.892057:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.892085:0:18655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.892097:0:18655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873981.892125:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788873981.892201:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.893453:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168128 00000100:00100000:0.0:1788873981.893465:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168128 00000100:00100000:0.0:1788873981.893510:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788873981.893519:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+19:18655:x1875769859168128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873981.893534:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873981.893798:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c963 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.893824:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 20 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.893835:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 20 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.893844:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad8400, rc 0) 00000100:00100000:0.0:1788873981.893894:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168128:12345-0@lo:101:mount.lustre.0 Request processed in 376us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.893900:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788873981.894124:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458005d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.894149:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873981.894167:0:18655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.894178:0:18655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873981.895419:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788873981.896093:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873981.898456:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788873981.898514:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788873981.899304:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788873981.899315:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788873981.899417:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873981.899482:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.899820:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458005180 going to sleep for 11 seconds 00000100:00100000:2.0:1788873981.902993:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168256 00000100:00100000:2.0:1788873981.903011:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168256 00000100:00100000:2.0:1788873981.903124:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788873981.903134:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873981.903332:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168256:12345-0@lo:501:mount.lustre.0 Request processed in 199us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873981.903340:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788873981.904955:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873981.905018:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873981.905108:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.905152:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458005180 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.905270:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168384 00000100:00100000:3.0:1788873981.905276:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168384 00000100:00100000:3.0:1788873981.905318:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788873981.905327:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873981.905454:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168384:12345-0@lo:503:mount.lustre.0 Request processed in 128us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.905469:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788873981.905566:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788873981.906013:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873981.906094:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873981.906137:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.906166:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.906242:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168512 00000100:00100000:3.0:1788873981.906246:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168512 00000100:00100000:3.0:1788873981.906268:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788873981.906274:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873981.906352:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168512:12345-0@lo:502:mount.lustre.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.906360:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788873981.906441:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873981.906600:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788873981.906625:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788873981.906640:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788873981.906653:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788873981.906668:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788873981.906681:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788873981.906694:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788873981.906707:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788873981.906720:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788873981.906733:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788873981.906746:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788873981.906764:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873981.906798:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.906824:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458005d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.906870:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168640 00000100:00100000:3.0:1788873981.906875:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168640 00000100:00100000:3.0:1788873981.906896:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788873981.906902:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873981.906977:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168640:12345-0@lo:502:mount.lustre.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.906984:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788873981.907114:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873981.907150:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788873981.907157:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788873981.908192:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873981.912399:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.912406:0:18677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788873981.912430:0:18677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3480d47000 00000020:00000080:0.0:1788873981.912434:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788873981.912443:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873981.912447:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.912448:0:18677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788873981.912451:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873981.912454:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.912456:0:18677:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788873981.912459:0:18677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3480d47000 00000020:00000080:0.0:1788873981.912475:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788873981.912629:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873981.912634:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.912635:0:18677:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788873981.912638:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873981.912640:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.912641:0:18677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788873981.912645:0:18677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3480d47000 00000020:00000080:0.0:1788873981.912647:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788873981.915339:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873981.915351:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.915353:0:18677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788873981.915357:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873981.915361:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.915363:0:18677:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788873981.915367:0:18677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3480d47000 00000020:00000080:0.0:1788873981.915369:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788873981.915428:0:18677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873981.915430:0:18677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873981.915432:0:18677:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788873981.915435:0:18677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788873981.915588:0:18655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788873981.915617:0:18655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788873981.915642:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.915655:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873981.915709:0:18655:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788873981.915712:0:18655:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3480d47000 10000000:01000000:1.0:1788873981.915715:0:18655:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3480d47000 10000000:01000000:1.0:1788873981.915719:0:18655:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788873981.915724:0:18655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3480d47000 from 1 10000000:01000000:1.0:1788873981.915726:0:18655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788873981.915760:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.915769:0:18655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.915780:0:18655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873981.915804:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788873981.915874:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.915919:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1788873981.916025:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168768 00000100:00100000:3.0:1788873981.916034:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168768 00000100:00100000:3.0:1788873981.916128:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788873981.916139:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:18655:x1875769859168768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873981.916152:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873981.916164:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442400/0x25c660afb0a9c978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c971 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873981.916186:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442400/0x25c660afb0a9c978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c971 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873981.916197:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442400/0x25c660afb0a9c978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c971 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873981.916249:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442400, rc 0) 00000100:00100000:3.0:1788873981.916297:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859168768:12345-0@lo:101:mount.lustre.0 Request processed in 160us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873981.916303:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788873981.916386:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873981.916400:0:18655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c978 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.916409:0:18655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c978 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873981.931707:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788873981.932116:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873981.932355:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788873981.932380:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788873981.932413:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788873981.932430:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788873981.932445:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788873981.932457:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788873981.932471:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788873981.932483:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788873981.932495:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788873981.932507:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788873981.932519:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788873981.932531:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788873981.934689:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788873981.934716:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788873981.934731:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788873981.934745:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788873981.934757:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788873981.934770:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788873981.934801:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788873981.934818:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788873981.934833:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788873981.934847:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788873981.934863:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788873981.934878:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788873981.934892:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788873981.934908:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788873981.934923:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788873981.934938:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788873981.934953:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788873981.934969:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788873981.934982:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788873981.934997:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788873981.935010:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788873981.935035:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788873981.935073:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788873981.935088:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788873981.935100:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788873981.935127:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788873981.935134:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788873981.935256:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873981.935323:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.935374:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1788873981.935859:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859168896 00000100:00100000:2.0:1788873981.935867:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859168896 00000100:00100000:2.0:1788873981.935923:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788873981.935933:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859168896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873981.936066:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859168896:12345-0@lo:501:mount.lustre.0 Request processed in 134us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873981.936083:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788873981.937711:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859168896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873981.937765:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873981.937827:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.937873:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.938265:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169024 00000100:00100000:1.0:1788873981.938271:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169024 00000100:00100000:1.0:1788873981.938316:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788873981.938325:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873981.938434:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169024:12345-0@lo:503:mount.lustre.0 Request processed in 110us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.938442:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788873981.938497:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788873981.938953:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788873981.939023:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.939073:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.939104:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.939120:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169152 00000100:00100000:1.0:1788873981.939130:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169152 00000100:00100000:1.0:1788873981.939157:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788873981.939164:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.939266:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169152:12345-0@lo:502:mount.lustre.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.939273:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788873981.939315:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873981.939472:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788873981.939497:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788873981.939511:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788873981.939525:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788873981.939538:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788873981.939551:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788873981.939564:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788873981.939576:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788873981.939608:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788873981.939623:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788873981.939636:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788873981.939648:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788873981.939658:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788873981.939669:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788873981.939680:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788873981.939693:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788873981.939704:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788873981.939716:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788873981.939729:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788873981.939742:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788873981.939753:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788873981.939765:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788873981.939778:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788873981.939803:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788873981.939832:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788873981.939846:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788873981.939858:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788873981.939870:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788873981.939883:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788873981.939895:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788873981.939907:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788873981.939937:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788873981.939948:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788873981.939960:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788873981.939974:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788873981.939988:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788873981.940003:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788873981.940015:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788873981.940025:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788873981.940037:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788873981.940074:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788873981.940092:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788873981.940104:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788873981.940115:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788873981.940139:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788873981.940152:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788873981.940165:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788873981.940178:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788873981.940234:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.940281:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.940315:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169280 00000100:00100000:1.0:1788873981.940320:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169280 00000100:00100000:1.0:1788873981.940347:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788873981.940353:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.940434:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169280:12345-0@lo:502:mount.lustre.0 Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.940441:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788873981.940474:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.940487:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873981.940617:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788873981.940639:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788873981.940657:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.940691:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.940712:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169408 00000100:00100000:1.0:1788873981.940715:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169408 00000100:00100000:1.0:1788873981.940736:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788873981.940742:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873981.940798:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859169408:12345-0@lo:502:mount.lustre.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.940805:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788873981.940835:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.940847:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859169408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873981.940881:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788873981.940888:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788873981.946623:0:18682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788873981.946641:0:18682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d34584ab380) 00000020:00000080:0.0:1788873981.946666:0:18682:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788873981.946752:0:18682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3480d47000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788873981.946763:0:18682:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3480d47000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788873981.946766:0:18682:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3480d47000 3 00010000:00080000:0.0:1788873981.946796:0:18682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3480d4e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.120@tcp at head 00010000:00010000:1.0:1788873981.951074:0:18682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788873981.951326:0:18682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788873981.951376:0:18682:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788873981.951389:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x25c660afb0a9c986 00000100:00080000:1.0:1788873981.951400:0:18682:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788873981.951407:0:18682:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3480d4e800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873981.951453:0:18682:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3475efa680 x1875769859169536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873981.951474:0:18682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788873981.951527:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.951532:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873981.951534:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.951537:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873981.951559:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.951562:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873981.951564:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.951567:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788873981.951601:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859169664:0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.951667:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.951702:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788873981.951708:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859170048:0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.951733:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.951765:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859169792:0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.951789:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.951807:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873981.951813:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859169920:0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.951835:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.951874:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169664 00000100:00100000:1.0:1788873981.951881:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169664 00000100:00100000:1.0:1788873981.951921:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169920 00000100:00100000:1.0:1788873981.951924:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169920 00000100:00100000:1.0:1788873981.951940:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788873981.951950:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859169664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.952004:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859169664:12345-0@lo:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.952010:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788873981.952026:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788873981.952031:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859169920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.952080:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859169920:12345-0@lo:400:kworker.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.952086:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788873981.952110:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170048 00000100:00100000:1.0:1788873981.952114:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170048 00000100:00100000:1.0:1788873981.952136:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169792 00000100:00100000:1.0:1788873981.952139:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169792 00000100:00100000:1.0:1788873981.952151:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873981.952156:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859170048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.952228:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859170048:12345-0@lo:400:kworker.0 Request processed in 47us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.952235:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873981.952248:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788873981.952254:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859169792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.952280:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859169792:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.952286:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788873981.952318:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475efa300 x1875769859170048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873981.952338:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859170048:0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.952351:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859169664:0@lo:400:kworker.0 00000100:00100000:1.0:1788873981.952380:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859169920:0@lo:400:kworker.0 00010000:00080000:1.0:1788873981.952390:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475efaa00 x1875769859169792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873981.952398:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859169792:0@lo:400:kworker.0 00000100:00100000:3.0:1788873981.953035:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859169536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788873981.953088:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.953392:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859169536 00000100:00100000:0.0:1788873981.953398:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859169536 00000100:00100000:0.0:1788873981.953435:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788873981.953441:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875769859169536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788873981.953467:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1788873981.953514:0:17157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x25c660afb0a9c98d 00000004:00100000:0.0:1788873981.953531:0:17157:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788873981.953577:0:17157:0:(import.c:65:import_set_state_nolock()) ffff9d3480d4c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788873981.953624:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875769859169536:12345-0@lo:38:llog_process_th.0 Request processed in 183us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.953631:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788873981.953768:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3475efa680 x1875769859169536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873981.953778:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873981.953788:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788873981.953796:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788873981.953802:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788873981.953804:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3480d4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788873981.953810:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1875769859169536:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788873981.955988:0:18682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788873981.956006:0:18682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d34584acd40) 00000020:00000080:0.0:1788873981.956031:0:18682:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788873981.956156:0:18682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3480d47000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788873981.956161:0:18682:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3480d47000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788873981.956163:0:18682:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3480d47000 3 00010000:00080000:0.0:1788873981.956191:0:18682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d345053e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.120@tcp at head 00010000:00010000:0.0:1788873981.960375:0:18682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788873981.962780:0:18682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788873981.962837:0:18682:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788873981.962850:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x25c660afb0a9c99b 00000100:00080000:0.0:1788873981.962861:0:18682:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873981.962868:0:18682:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d345053e800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873981.962907:0:18682:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d33441b9f80 x1875769859170176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788873981.962951:0:18682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788873981.963656:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1875769859170176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788873981.963730:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.963945:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170176 00000100:00100000:0.0:1788873981.963953:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170176 00000100:00100000:0.0:1788873981.963986:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788873981.963995:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1875769859170176:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788873981.964024:0:17156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1788873981.964087:0:17156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x25c660afb0a9c9a2 00000004:00100000:0.0:1788873981.964104:0:17156:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788873981.964139:0:17156:0:(import.c:65:import_set_state_nolock()) ffff9d3480d4b800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788873981.964369:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.964375:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873981.964377:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.964380:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873981.964383:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.964386:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873981.964388:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873981.964391:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788873981.964553:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875769859170176:12345-0@lo:38:llog_process_th.0 Request processed in 558us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.964562:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1788873981.966770:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788873981.967029:0:18655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788873981.967136:0:18655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788873981.967154:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c978 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.967196:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecae00/0x25c660afb0a9c971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c978 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788873981.967296:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788873981.967298:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788873981.967299:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873981.967300:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873981.967302:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873981.967303:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873981.967305:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788873981.967307:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873981.967309:0:18655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788873981.967313:0:18655:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788873981.967316:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788873981.967317:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788873981.967318:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873981.967319:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873981.967320:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873981.967321:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873981.967322:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788873981.967324:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873981.967324:0:18655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788873981.967351:0:18655:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788873981.967375:0:18655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859170304:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788873981.967454:0:18655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.967503:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170304 00000100:00100000:1.0:1788873981.967510:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170304 00000100:00100000:1.0:1788873981.967569:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788873981.967579:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859170304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788873981.967608:0:17150:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788873981.967623:0:17150:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788873981.967898:0:18655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34511ca900 going to sleep for 11 seconds 20000000:01000000:0.0:1788873981.969852:0:17150:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788873981.969874:0:17150:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788873981.970187:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:18655:x1875769859170304:12345-0@lo:253:mount.lustre.0 Request processed in 2603us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.970198:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:1.0:1788873981.970617:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788873981.970623:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788873981.970646:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.970683:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 20 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.970691:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.970697:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.970735:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.970749:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 20 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873981.970765:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859170432:0@lo:104: 00000100:00100000:1.0:1788873981.970806:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873981.970840:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 20 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.970849:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 20 pid: 17148 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873981.970858:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859170560:0@lo:104: 00000100:00100000:1.0:1788873981.970882:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873981.970900:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458654240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873981.970926:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788873981.970940:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170432 00000100:00100000:1.0:1788873981.970947:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170432 00000100:00100000:1.0:1788873981.970987:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170560 00000100:00100000:1.0:1788873981.970990:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170560 00000100:00100000:1.0:1788873981.971004:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873981.971013:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+4:17171:x1875769859170432:12345-0@lo:104: 00010000:00010000:1.0:1788873981.971028:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.971084:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788873981.971090:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+4:17171:x1875769859170432:12345-0@lo:104: Request processed in 79us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.971097:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788873981.971109:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873981.971115:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3463fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859170560:12345-0@lo:104: 00010000:00010000:1.0:1788873981.971123:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873981.971161:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788873981.971166:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3463fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859170560:12345-0@lo:104: Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873981.971173:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788873981.971246:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859170432:0@lo:104: 00000100:00100000:1.0:1788873981.971255:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859170560:0@lo:104: 00010000:00010000:1.0:1788873981.971273:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873981.971303:0:18655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:18655:1875769859170304:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788873981.971313:0:18655:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788873981.971322:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788873981.971324:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788873981.971325:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788873981.971326:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788873981.971327:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788873981.971328:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788873981.971330:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788873981.971331:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788873981.971333:0:18655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788873981.971344:0:18655:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788873981.971648:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788873981.971655:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971663:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873981.971666:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971675:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873981.971694:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873981.971700:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788873981.971730:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971737:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873981.971758:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971766:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f443e00/0x25c660afb0a9c8fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c901 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971779:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788873981.971782:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971788:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788873981.971791:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971798:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788873981.971805:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873981.971810:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788873981.971828:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971834:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788873981.971850:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971857:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475eca600/0x25c660afb0a9c8ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c8f3 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.971871:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873981.971873:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873981.971875:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873981.971900:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859170688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873981.971942:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.971986:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859170816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873981.972010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873981.972062:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170688 00000100:00100000:0.0:1788873981.972067:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170688 00010000:00010000:0.0:1788873981.972087:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 21 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873981.972112:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170816 00000100:00100000:0.0:1788873981.972115:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170816 00010000:00010000:0.0:1788873981.972127:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 22 pid: 17148 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873981.972140:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788873981.972148:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+22:3634:x1875769859170688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873981.972158:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873981.972170:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 22 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972181:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 22 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972195:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9c901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c8fa expref: 22 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972222:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873981.972251:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+21:3634:x1875769859170688:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.972259:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788873981.972273:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873981.972279:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a6e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+20:3635:x1875769859170816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873981.972287:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788873981.972291:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 20 pid: 17148 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972300:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 20 pid: 17148 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972310:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c8f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c8ec expref: 20 pid: 17148 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972321:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972329:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788873981.972351:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006491093s 00010000:00010000:0.0:1788873981.972356:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972363:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972369:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972375:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972380:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788873981.972384:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972392:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972406:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.972415:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788873981.972442:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a6e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+19:3635:x1875769859170816:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873981.972449:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788873981.972524:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859170816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788873981.974308:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859170688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788873981.974347:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.974357:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873981.974365:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788873981.974467:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d33441b9f80 x1875769859170176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873981.974479:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873981.974487:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788873981.974497:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788873981.974502:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788873981.974505:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d345053e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788873981.974518:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1875769859170176:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1788873981.974530:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788873981.978614:0:18655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788873981.985381:0:18655:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788873981.985391:0:18655:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788873981.985432:0:18655:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788873981.985487:0:18655:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788873981.985509:0:18655:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788873981.985550:0:18655:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788873981.986437:0:18655:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873981.986689:0:18655:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788873982.063192:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788873982.841731:0:18735:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873982.841995:0:18735:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788873983.089868:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873983.214407:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788873983.214433:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859170944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873983.214526:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873983.214764:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859170944 00000100:00100000:1.0:1788873983.214773:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859170944 00000100:00100000:1.0:1788873983.214822:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788873983.214832:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859170944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873983.214863:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788873983.214909:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859170944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873983.214916:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788873983.214959:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859170944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788873983.215714:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859171072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873983.215759:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873983.215979:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171072 00000100:00100000:3.0:1788873983.215986:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171072 00000100:00100000:3.0:1788873983.216040:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788873983.216050:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859171072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873983.216167:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788873983.216255:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859171072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 206us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873983.216262:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788873983.216339:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859171072:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788873983.411766:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788873983.411773:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3475f37800 from 9 10000000:01000000:2.0:1788873983.411778:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788873983.411827:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873983.411838:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873983.411850:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873983.411876:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788873983.411947:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873983.411997:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058600 going to sleep for 11 seconds 00000100:00100000:0.0:1788873983.412410:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171200 00000100:00100000:0.0:1788873983.412418:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171200 00000100:00100000:0.0:1788873983.412753:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788873983.412764:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+19:17152:x1875769859171200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873983.412779:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873983.412796:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c9b0 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873983.412821:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 20 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873983.412832:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 20 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873983.412842:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9800, rc 0) 00000100:00100000:0.0:1788873983.412896:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+20:17152:x1875769859171200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873983.412903:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788873983.413078:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873983.413095:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873983.413106:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873983.413168:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788873983.413198:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873983.413666:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873983.417801:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171328 00000100:00100000:3.0:1788873983.417816:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171328 00000100:00100000:3.0:1788873983.417870:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788873983.417880:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:17152:x1875769859171328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788873983.417906:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788873983.417925:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788873983.417929:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788873983.418261:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+20:17152:x1875769859171328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 380us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873983.418269:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788873983.418322:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788873983.418785:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788873983.418797:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873983.418808:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788873983.418828:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788873983.418831:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3442ab2000 from 9 10000000:01000000:3.0:1788873983.418834:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788873983.418867:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873983.418877:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873983.418887:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873983.418910:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788873983.418948:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873983.419996:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480e60300 going to sleep for 11 seconds 00000100:00100000:0.0:1788873983.424328:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171456 00000100:00100000:0.0:1788873983.424348:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171456 00000100:00100000:0.0:1788873983.424726:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788873983.424737:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+20:17152:x1875769859171456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873983.424754:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873983.424772:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c9be expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873983.424800:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873983.424812:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873983.424822:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3343ad9c00, rc 0) 00000100:00100000:0.0:1788873983.424900:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859171456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873983.424907:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788873983.426054:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873983.426076:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873983.426087:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873983.426153:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788873983.426235:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873983.426266:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788873983.426400:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171584 00000100:00100000:1.0:1788873983.426408:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171584 00000100:00100000:1.0:1788873983.426449:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788873983.426743:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859171584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788873983.426763:0:17150:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788873983.426780:0:17150:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788873983.426784:0:17150:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788873983.426880:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859171584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 417us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873983.426888:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788873983.428523:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859171584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788873983.428599:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788873983.428610:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873983.428621:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873984.111255:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873985.134329:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873986.159358:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873987.182444:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788873987.310531:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873987.310538:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873987.310542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873987.310551:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873987.310567:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873987.310580:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788873987.310583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788873987.310586:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788873987.310634:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859171840:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.310700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873987.310749:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859172352:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.310780:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873987.310801:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788873987.310806:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859171968:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.310822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873987.310836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859172480:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.310855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873987.310883:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171840 00000100:00100000:2.0:1788873987.310890:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171840 00000100:00100000:2.0:1788873987.310932:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788873987.311302:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859171840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.311360:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859171840:12345-0@lo:400:kworker.0 Request processed in 62us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873987.311366:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788873987.311394:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172352 00000100:00100000:2.0:1788873987.311398:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172352 00000100:00100000:2.0:1788873987.311423:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171968 00000100:00100000:2.0:1788873987.311432:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171968 00000100:00100000:2.0:1788873987.311443:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172480 00000100:00100000:2.0:1788873987.311445:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172480 00000100:00100000:2.0:1788873987.311457:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788873987.311462:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859172352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.311489:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859172352:12345-0@lo:400:kworker.0 Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873987.311494:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788873987.311503:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788873987.311508:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859171968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.311527:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859171968:12345-0@lo:400:kworker.0 Request processed in 20us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873987.311533:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788873987.311541:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788873987.311546:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859172480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.311564:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859172480:12345-0@lo:400:kworker.0 Request processed in 19us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873987.311632:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788873987.311674:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347a726a00 x1875769859171968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873987.311688:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859171968:0@lo:400:kworker.0 00010000:00080000:2.0:1788873987.311698:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347a725c00 x1875769859172480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873987.311705:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859172480:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.311713:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859171840:0@lo:400:kworker.0 00010000:00080000:2.0:1788873987.311728:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347a725180 x1875769859172352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873987.311736:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859172352:0@lo:400:kworker.0 00000100:00100000:3.0:1788873987.311860:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859171712:0@lo:400:kworker.0 00000100:00100000:3.0:1788873987.311910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873987.311952:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859172224:0@lo:400:kworker.0 00000100:00100000:3.0:1788873987.311972:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873987.311987:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788873987.312002:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859172096:0@lo:400:kworker.0 00000100:00100000:3.0:1788873987.312026:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873987.312060:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859171712 00000100:00100000:3.0:1788873987.312063:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859171712 00000100:00100000:3.0:1788873987.312088:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788873987.312094:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:3634:x1875769859171712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873987.312132:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:3634:x1875769859171712:12345-0@lo:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873987.312138:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788873987.312166:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859171712:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.312301:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172096 00000100:00100000:2.0:1788873987.312305:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172096 00000100:00100000:2.0:1788873987.312334:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788873987.312340:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859172096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.312373:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859172096:12345-0@lo:400:kworker.0 Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873987.312379:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788873987.312399:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859172096:0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.312411:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172224 00000100:00100000:2.0:1788873987.312413:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172224 00000100:00100000:2.0:1788873987.312430:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788873987.312435:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859172224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873987.312461:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859172224:12345-0@lo:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873987.312467:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788873987.312486:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347a724700 x1875769859172224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873987.312496:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347a724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859172224:0@lo:400:kworker.0 00000100:00080000:1.0:1788873987.312631:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873987.312636:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788873987.638506:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788873988.221262:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873988.334398:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859172608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873988.334465:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873988.334728:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859172736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873988.335025:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873988.335071:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172608 00000100:00100000:2.0:1788873988.335093:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172608 00000100:00100000:2.0:1788873988.335131:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172736 00000100:00100000:2.0:1788873988.335134:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172736 00000100:00100000:2.0:1788873988.335150:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873988.335158:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859172608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873988.335191:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788873988.335252:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859172608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873988.335259:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788873988.335275:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788873988.335282:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859172736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873988.335297:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788873988.335331:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859172736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873988.335336:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788873988.335374:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859172736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873988.335403:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859172608:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788873988.702892:0:19024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788873989.230814:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788873989.423797:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788873989.712380:0:19077:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873989.712598:0:19077:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788873990.265286:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788873990.632170:0:19127:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788873990.632434:0:19127:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873991.279404:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873992.242156:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873977/real 1788873977] req@ffff9d3343992680 x1875769859165184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873992.242185:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343992680 x1875769859165184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873992 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873992.242196:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873977/real 1788873977] req@ffff9d3343993100 x1875769859165312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873992.242252:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3343993100 x1875769859165312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788873992 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788873992.242274:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d34505d4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788873992.242298:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1788873992.242444:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873992.242449:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873992.242452:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873992.242455:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788873992.242488:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873992.242492:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788873992.242494:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d34505d4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788873992.242499:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1788873992.242504:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788873992.242510:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d34505d4800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:1.0:1788873992.242526:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3475efb100 x1875769859173376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788873992.242538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788873992.242541:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788873992.242573:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859172992:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242674:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859173632:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242723:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788873992.242729:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859172864:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242785:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859173504:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242823:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859173120:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242840:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242856:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859173760:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242877:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242886:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788873992.242890:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859173248:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.242905:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.242932:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172992 00000100:00100000:1.0:1788873992.242938:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172992 00000100:00100000:1.0:1788873992.242978:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173248 00000100:00100000:1.0:1788873992.242981:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173248 00000100:00100000:1.0:1788873992.242995:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873992.243002:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859172992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243056:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859172992:12345-0@lo:400:kworker.0 Request processed in 54us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243063:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788873992.243078:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788873992.243083:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859173248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243106:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859173248:12345-0@lo:400:kworker.0 Request processed in 23us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243112:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788873992.243126:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173632 00000100:00100000:1.0:1788873992.243129:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173632 00000100:00100000:1.0:1788873992.243151:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173504 00000100:00100000:1.0:1788873992.243153:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173504 00000100:00100000:1.0:1788873992.243161:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173120 00000100:00100000:1.0:1788873992.243163:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173120 00000100:00100000:1.0:1788873992.243170:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173760 00000100:00100000:1.0:1788873992.243172:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173760 00000100:00100000:1.0:1788873992.243182:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873992.243188:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859173632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243235:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875769859173632:12345-0@lo:400:kworker.0 Request processed in 47us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243241:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788873992.243251:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788873992.243256:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859173504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243276:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875769859173504:12345-0@lo:400:kworker.0 Request processed in 21us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243281:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788873992.243289:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788873992.243300:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859173120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243394:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859173120:12345-0@lo:400:kworker.0 Request processed in 95us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243400:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788873992.243411:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788873992.243416:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859173760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243437:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875769859173760:12345-0@lo:400:kworker.0 Request processed in 21us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243442:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788873992.243458:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859172864 00000100:00100000:1.0:1788873992.243462:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859172864 00000100:00100000:1.0:1788873992.243485:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788873992.243491:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:3636:x1875769859172864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243518:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+21:3636:x1875769859172864:12345-0@lo:400:kworker.0 Request processed in 27us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.243524:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788873992.243554:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873992.243558:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788873992.243580:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859173248:0@lo:400:kworker.0 00010000:00080000:1.0:1788873992.243590:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475ef9180 x1875769859173120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873992.243600:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859173120:0@lo:400:kworker.0 00010000:00080000:1.0:1788873992.243608:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475efbb80 x1875769859173760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873992.243615:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1875769859173760:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243655:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859172864:0@lo:400:kworker.0 00010000:00080000:1.0:1788873992.243664:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475ef9c00 x1875769859173504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873992.243671:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875769859173504:0@lo:400:kworker.0 00000100:00100000:1.0:1788873992.243680:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859172992:0@lo:400:kworker.0 00010000:00080000:1.0:1788873992.243689:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475efa680 x1875769859173632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873992.243696:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1875769859173632:0@lo:400:kworker.0 00000100:00100000:0.0:1788873992.243762:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859165184:0@lo:8:kworker.0 00000100:00080000:0.0:1788873992.243769:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788873992.243785:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788873992.243788:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859165312:0@lo:8:kworker.0 00000100:00100000:0.0:1788873992.243805:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859173376:0@lo:8:kworker.0 00000100:00100000:0.0:1788873992.243837:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873992.243931:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173376 00000100:00100000:2.0:1788873992.243935:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173376 00000100:00100000:2.0:1788873992.243970:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873992.243976:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3632:x1875769859173376:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788873992.244003:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:2.0:1788873992.244035:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9c9cc 00002000:00100000:2.0:1788873992.244047:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d3343979000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788873992.244051:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788873992.244054:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788873992.244230:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788873992.244251:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9d334397d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788873992.244286:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875769859173376:12345-0@lo:8:kworker.0 Request processed in 310us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873992.244293:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788873992.245459:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3475efb100 x1875769859173376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788874012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873992.245472:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788873992.245481:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788873992.245489:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788873992.245495:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788873992.245498:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d34505d4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788873992.245511:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788873992.245516:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859173376:0@lo:8:kworker.0 00000004:00080000:0.0:1788873992.245568:0:17897:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788873992.245587:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17897:1875769859174016:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788873992.245626:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873992.245646:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf240 going to sleep for 11 seconds 00000004:00080000:0.0:1788873992.245667:0:17896:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788873992.245743:0:17896:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 529191538316ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788873992.245750:0:17896:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788873992.245780:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174016 00000100:00100000:0.0:1788873992.245785:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174016 00000100:00100000:0.0:1788873992.245827:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788873992.245835:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17897:x1875769859174016:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788873992.246118:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859173888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873992.246146:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788873992.246170:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788873992.246231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873992.246235:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788873992.246238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873992.246241:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788873992.246245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788873992.246248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788873992.246250:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788873992.246254:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1788873992.246258:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788873992.246262:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d33428ea800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873992.246280:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d33441b9500 x1875769859174144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788873992.246435:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859174144:0@lo:8:kworker.0 00000100:00100000:0.0:1788873992.246464:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873992.246789:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788873992.246798:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788873992.247301:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859173888 00000100:00100000:2.0:1788873992.247392:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859173888 00000100:00100000:2.0:1788873992.247439:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788873992.247448:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3634:x1875769859173888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788873992.247474:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788873992.247530:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3634:x1875769859173888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873992.247536:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788873992.247574:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33441baa00 x1875769859173888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873992.247593:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859173888:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788873992.248021:0:17888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788873992.249632:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174144 00000100:00100000:0.0:1788873992.249645:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174144 00000100:00100000:2.0:1788873992.249807:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788873992.249815:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1875769859174144:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788873992.249840:0:19195:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00080000:1.0:1788873992.258446:0:18663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788873992.258456:0:18663:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788873992.258551:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17897:x1875769859174016:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12712us (12919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.258562:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788873992.258565:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33441b8a80 x1875769859174016/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788874008 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873992.258581:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17897:1875769859174016:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788873992.258595:0:17897:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788873992.258646:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17897:1875769859174272:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788873992.258682:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873992.258720:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334382d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873992.261423:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174272 00000100:00100000:1.0:1788873992.261437:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174272 00000100:00100000:1.0:1788873992.261500:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788873992.261511:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17897:x1875769859174272:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788873992.261543:0:18662:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788873992.261624:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17897:x1875769859174272:12345-0@lo:5:osp-pre-0-1.0 Request processed in 115us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873992.261632:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788873992.261657:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a1c00 x1875769859174272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874008 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873992.261672:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17897:1875769859174272:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788873992.261686:0:17897:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788873992.261729:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17897:1875769859174400:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788873992.261762:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873992.261795:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334382d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788873992.262448:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174400 00000100:00100000:1.0:1788873992.262455:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174400 00000100:00100000:1.0:1788873992.262509:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788873992.262517:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17897:x1875769859174400:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788873992.262552:0:18663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788873992.277447:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1875769859174144:12345-0@lo:8:kworker.0 Request processed in 27625us (30974us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788873992.277471:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788873992.279382:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788873992.279393:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788873992.279399:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859174144:0@lo:8:kworker.0 00000001:00080000:0.0:1788873992.288781:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788873992.288800:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788873992.289173:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17897:x1875769859174400:12345-0@lo:5:osp-pre-0-1.0 Request processed in 26651us (27405us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788873992.289185:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788873992.289862:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a1c00 x1875769859174400/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873992.289876:0:17897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788873992.289884:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17897:1875769859174400:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788873992.289900:0:17897:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788873992.289966:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17897:1875769859174528:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788873992.290017:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873992.290049:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873992.293061:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174528 00000100:00100000:2.0:1788873992.293076:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174528 00000100:00100000:2.0:1788873992.293140:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788873992.293152:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17897:x1875769859174528:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788873992.293316:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17897:x1875769859174528:12345-0@lo:900:osp-pre-0-1.0 Request processed in 166us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873992.293324:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788873992.293481:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33441b9f80 x1875769859174528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788874008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873992.293498:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17897:1875769859174528:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788873992.303597:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873993.332085:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873993.454913:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859174656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873993.455003:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873993.455061:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174656 00000100:00100000:2.0:1788873993.455069:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174656 00000100:00100000:2.0:1788873993.455118:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788873993.455127:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859174656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873993.455161:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788873993.455223:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859174656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873993.455231:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788873993.455279:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859174656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873993.457662:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788873993.457684:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859174784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873993.457743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873993.457944:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174784 00000100:00100000:0.0:1788873993.457952:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174784 00000100:00100000:0.0:1788873993.458004:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788873993.458014:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859174784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873993.458045:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788873993.458105:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859174784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873993.458112:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788873993.458289:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859174784:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788873994.350612:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873995.377510:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788873996.403608:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788873996.602108:0:19473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788873996.602113:0:19473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788873996.602114:0:19473:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788873996.602537:0:19473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d347a75c800 00000020:01000004:1.0:1788873996.602554:0:19473:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788873996.602702:0:19473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788873996.607480:0:19473:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d347a8ccd40) 00000020:00000080:2.0:1788873996.607521:0:19473:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788873996.722254:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788873996.729525:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788873996.729977:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788873996.730415:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788873996.730760:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788873996.731022:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788873996.731294:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788873996.734418:0:19473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788873996.734663:0:19473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788873996.734681:0:19473:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788873996.734695:0:19473:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c660afb0a9c9da 00000020:01000004:2.0:1788873996.734704:0:19473:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788873996.734728:0:19473:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788873996.734732:0:19473:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788873996.734739:0:19473:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788873996.734769:0:19473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788873996.734774:0:19473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788873996.757461:0:19473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788873996.757499:0:19473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788873996.757503:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788873996.757505:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873996.757507:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873996.757508:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873996.757509:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873996.757511:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873996.757512:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873996.757513:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873996.757515:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788873996.757518:0:19473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788873996.757520:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788873996.757521:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873996.757522:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873996.757523:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873996.757524:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873996.757526:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873996.757526:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873996.757528:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873996.757532:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788873996.757615:0:19473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788873996.757637:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859174912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788873996.757703:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873996.757805:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d334382d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788873996.762731:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859174912 00000100:00100000:0.0:1788873996.762745:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859174912 00000100:00100000:1.0:1788873996.762900:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788873996.762921:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:19473:x1875769859174912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788873996.762978:0:17148:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788873996.762982:0:17148:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788873996.762986:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788873996.763409:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:19473:x1875769859174912:12345-0@lo:253:mount.lustre.0 Request processed in 490us (5705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873996.763419:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788873996.763740:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859174912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788873996.763756:0:19473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788873996.763760:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788873996.763761:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788873996.763762:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788873996.763763:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788873996.763764:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788873996.763765:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788873996.763766:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788873996.763768:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788873996.763769:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788873996.763790:0:19473:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d347a75c800 from lustre-OST0001 10000000:01000000:0.0:1788873996.763819:0:19473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788873996.763822:0:19473:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788873996.763831:0:19473:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3342964d40 local copy 00010000:00010000:0.0:1788873996.763840:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873996.763944:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873996.763983:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873996.764020:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788873996.764071:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175040 00000100:00100000:2.0:1788873996.764076:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175040 00000100:00100000:1.0:1788873996.764684:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788873996.764694:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:19473:x1875769859175040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873996.764779:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:19473:x1875769859175040:12345-0@lo:501:mount.lustre.0 Request processed in 86us (794us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788873996.764787:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788873996.764928:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175040:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788873996.764944:0:19473:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788873996.764965:0:19473:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788873996.764972:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.764982:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3343ad9200/0x25c660afb0a9c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c6fb expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873996.765016:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d347a75c800 10000000:01000000:0.0:1788873996.765022:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788873996.765027:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788873996.765030:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873996.765033:0:19473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788873996.765036:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788873996.765060:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.765067:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.765076:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873996.765190:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873996.765251:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873996.765350:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf240 going to sleep for 11 seconds 00000100:00100000:1.0:1788873996.769716:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175168 00000100:00100000:1.0:1788873996.769730:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175168 00000100:00100000:1.0:1788873996.769820:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788873996.769831:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:19473:x1875769859175168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788873996.769847:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788873996.769867:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c9e1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.769897:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c9e1 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.769917:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3475ecb400/0x25c660afb0a9c9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9e1 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.769925:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecb400, rc 0) 00000100:00100000:1.0:1788873996.769999:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175168:12345-0@lo:101:mount.lustre.0 Request processed in 169us (4748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873996.770006:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788873996.770197:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873996.770243:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9e8 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.770252:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9c9e8 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788873996.772253:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788873996.772988:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788873996.782826:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788873996.782888:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788873996.783030:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788873996.783052:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788873996.783068:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788873996.783698:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788873996.783748:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788873996.783755:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788873996.783867:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873996.783952:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873996.784005:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3445ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.786688:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175296 00000100:00100000:3.0:1788873996.786703:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175296 00000100:00100000:3.0:1788873996.786770:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788873996.786782:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873996.787018:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175296:12345-0@lo:501:mount.lustre.0 Request processed in 238us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.787026:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788873996.787388:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788873996.787451:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788873996.787503:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873996.787541:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3445ef16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.788256:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175424 00000100:00100000:3.0:1788873996.788265:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175424 00000100:00100000:3.0:1788873996.788316:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788873996.788324:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873996.789715:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175424:12345-0@lo:503:mount.lustre.0 Request processed in 1387us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.789727:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788873996.789865:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175424:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788873996.790378:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788873996.790470:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873996.790525:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873996.794507:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3445ef16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873996.800746:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175552 00000100:00100000:2.0:1788873996.800768:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175552 00000100:00100000:2.0:1788873996.800877:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788873996.800889:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873996.802660:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175552:12345-0@lo:502:mount.lustre.0 Request processed in 1765us (12125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.802676:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788873996.802857:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f355880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873996.803180:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788873996.803241:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788873996.803259:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788873996.803275:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788873996.803289:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788873996.803302:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788873996.803318:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788873996.803332:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788873996.803346:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788873996.803390:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873996.803450:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873996.803964:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.804022:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175680 00000100:00100000:3.0:1788873996.804030:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175680 00000100:00100000:3.0:1788873996.804075:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788873996.804378:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873996.804530:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175680:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.804538:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788873996.804744:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788873996.804826:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788873996.804840:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788873996.805925:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788873996.805936:0:19477:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788873996.805943:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873996.805946:0:19477:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788873996.805952:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788873996.805966:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d34584a8000) 00000020:00000080:0.0:1788873996.805992:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788873996.805998:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788873996.806306:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d347a75c800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788873996.806317:0:19477:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788873996.806324:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c660afb0a9c9f6 00010000:00010000:0.0:1788873996.811848:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788873996.813733:0:19477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788873996.816396:0:19477:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788873996.824693:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788873996.824708:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873996.824722:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873996.824724:0:19477:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788873996.824728:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873996.824733:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873996.824734:0:19477:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788873996.824737:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788873996.824739:0:19477:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788873996.824741:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873996.824744:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873996.824745:0:19477:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788873996.824748:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788873996.824750:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873996.824751:0:19477:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788873996.824754:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788873996.824786:0:19477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788873996.824790:0:19477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788873996.824792:0:19477:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788873996.824795:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788873996.824936:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788873996.824970:0:19473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788873996.824996:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9e8 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873996.825009:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92c00/0x25c660afb0a9c9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9c9e8 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788873996.825018:0:19473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d347a75c800 from 1 10000000:01000000:2.0:1788873996.825020:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788873996.825057:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873996.825066:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873996.825088:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788873996.825122:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788873996.825196:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873996.825264:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058840 going to sleep for 11 seconds 00000100:00100000:0.0:1788873996.825675:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175808 00000100:00100000:0.0:1788873996.825683:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175808 00000100:00100000:0.0:1788873996.825734:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788873996.825745:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+22:19473:x1875769859175808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788873996.825758:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873996.825772:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9c9fd expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.825797:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.825807:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.825814:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93000, rc 0) 00000100:00100000:0.0:1788873996.825872:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859175808:12345-0@lo:101:mount.lustre.0 Request processed in 129us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873996.825879:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788873996.826013:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788873996.826029:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873996.826039:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788873996.827596:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788873996.827936:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788873996.828182:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788873996.828232:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788873996.828255:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788873996.828260:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788873996.828349:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873996.828433:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873996.828495:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.828515:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859175936 00000100:00100000:3.0:1788873996.828523:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859175936 00000100:00100000:3.0:1788873996.828577:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788873996.828586:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859175936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873996.828712:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859175936:12345-0@lo:501:mount.lustre.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.828719:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788873996.828719:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859175936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873996.828748:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788873996.828788:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873996.828813:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058240 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.828940:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176064 00000100:00100000:3.0:1788873996.828944:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176064 00000100:00100000:3.0:1788873996.828983:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788873996.828989:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873996.829075:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176064:12345-0@lo:503:mount.lustre.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.829092:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788873996.829094:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000040:00080000:3.0:1788873996.829639:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788873996.829698:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873996.829739:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.829772:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345190e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788873996.830077:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176192 00000100:00100000:2.0:1788873996.830084:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176192 00000100:00100000:2.0:1788873996.834145:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788873996.834163:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873996.834352:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176192:12345-0@lo:502:mount.lustre.0 Request processed in 195us (4612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.834359:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788873996.834442:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873996.834667:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788873996.834697:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788873996.834713:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788873996.834726:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788873996.834739:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788873996.834753:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788873996.834767:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788873996.834779:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788873996.834793:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788873996.834809:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788873996.834826:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788873996.834872:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788873996.834933:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873996.834971:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a6de600 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.835232:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176320 00000100:00100000:3.0:1788873996.835238:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176320 00000100:00100000:3.0:1788873996.835278:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788873996.835285:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873996.835380:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176320:12345-0@lo:502:mount.lustre.0 Request processed in 94us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.835387:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788873996.835487:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788873996.835529:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788873996.835537:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788873996.837270:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788873996.837282:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873996.837285:0:19481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788873996.837293:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d347a75c800 00000020:00000080:2.0:1788873996.837295:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788873996.837303:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788873996.837305:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788873996.837308:0:19481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788873996.837311:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873996.837336:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873996.837339:0:19481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788873996.837344:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d347a75c800 00000020:00000080:3.0:1788873996.837347:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873996.837466:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873996.837471:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873996.837472:0:19481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788873996.837475:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873996.837478:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873996.837479:0:19481:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873996.837482:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d347a75c800 00000020:00000080:3.0:1788873996.837484:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873996.837505:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873996.837518:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873996.837519:0:19481:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788873996.837522:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788873996.837525:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873996.837526:0:19481:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788873996.837529:0:19481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d347a75c800 00000020:00000080:3.0:1788873996.837531:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788873996.837558:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788873996.837561:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788873996.837563:0:19481:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788873996.837565:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788873996.841142:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788873996.841196:0:19473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788873996.841234:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.841248:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788873996.841315:0:19473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788873996.841318:0:19473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d347a75c800 10000000:01000000:0.0:1788873996.841322:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d347a75c800 10000000:01000000:0.0:1788873996.841327:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788873996.841333:0:19473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d347a75c800 from 1 10000000:01000000:0.0:1788873996.841336:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788873996.841373:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.841382:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873996.841525:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788873996.841553:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788873996.841622:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873996.841673:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830540 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.842509:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176448 00000100:00100000:3.0:1788873996.842518:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176448 00000100:00100000:3.0:1788873996.842571:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788873996.842582:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+23:19473:x1875769859176448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788873996.842598:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788873996.842614:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443000/0x25c660afb0a9ca12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9ca0b expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.842641:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443000/0x25c660afb0a9ca12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9ca0b expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.842653:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443000/0x25c660afb0a9ca12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9ca0b expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.842662:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443000, rc 0) 00000100:00100000:3.0:1788873996.842732:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176448:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.842739:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788873996.842803:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788873996.842819:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca12 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873996.842828:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9ca12 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788873996.845181:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788873996.845538:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788873996.845754:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788873996.845782:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788873996.845796:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788873996.845811:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788873996.845825:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788873996.845838:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788873996.845853:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788873996.845865:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788873996.845879:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788873996.845920:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788873996.845939:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788873996.845953:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788873996.845966:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788873996.845980:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788873996.845993:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788873996.846006:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788873996.846021:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788873996.846036:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788873996.846051:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788873996.846065:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788873996.846079:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788873996.846094:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788873996.846107:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788873996.846122:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788873996.846136:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788873996.846164:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788873996.846180:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788873996.846193:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788873996.846241:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788873996.846261:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788873996.846276:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788873996.846291:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788873996.846304:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788873996.846327:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788873996.846341:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788873996.846354:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788873996.846367:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788873996.846380:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788873996.846393:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788873996.846405:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788873996.846418:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788873996.846447:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788873996.846464:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788873996.846479:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788873996.846493:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788873996.846507:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788873996.846527:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788873996.846533:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788873996.846617:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788873996.846687:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.846743:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345190e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788873996.846983:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176576 00000100:00100000:2.0:1788873996.846993:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176576 00000100:00100000:2.0:1788873996.847045:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788873996.847055:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788873996.847220:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176576:12345-0@lo:501:mount.lustre.0 Request processed in 151us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.847228:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788873996.847737:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788873996.847792:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788873996.847840:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873996.847880:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873996.847944:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176704 00000100:00100000:2.0:1788873996.847951:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176704 00000100:00100000:2.0:1788873996.847990:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788873996.847997:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788873996.848084:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176704:12345-0@lo:503:mount.lustre.0 Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.848090:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788873996.848300:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788873996.848704:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788873996.848775:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788873996.848814:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873996.848849:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788873996.848874:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176832 00000100:00100000:2.0:1788873996.848879:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176832 00000100:00100000:2.0:1788873996.848919:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788873996.848926:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873996.849073:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176832:12345-0@lo:502:mount.lustre.0 Request processed in 147us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.849081:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788873996.849315:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788873996.849481:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788873996.849507:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788873996.849521:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788873996.849535:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788873996.849549:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788873996.849649:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788873996.849666:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788873996.849679:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788873996.849692:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788873996.849715:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788873996.849742:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788873996.849756:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788873996.849769:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788873996.849781:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788873996.849794:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788873996.849807:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788873996.849819:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788873996.849832:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788873996.849845:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788873996.849858:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788873996.849869:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788873996.849882:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788873996.849896:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788873996.849924:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788873996.849939:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788873996.849954:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788873996.849979:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788873996.849994:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788873996.850007:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788873996.850019:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788873996.850032:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788873996.850046:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788873996.850059:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788873996.850073:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788873996.850087:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788873996.850399:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788873996.850420:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788873996.850434:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788873996.850446:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788873996.850460:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788873996.850473:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788873996.850485:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788873996.850518:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788873996.850535:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788873996.850549:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788873996.850892:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788873996.850925:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788873996.850941:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788873996.850994:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788873996.851061:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873996.851122:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3452058a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.852518:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859176960 00000100:00100000:3.0:1788873996.852531:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859176960 00000100:00100000:3.0:1788873996.852594:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788873996.852607:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873996.852769:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859176960:12345-0@lo:502:mount.lustre.0 Request processed in 164us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.852776:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788873996.852846:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859176960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788873996.853067:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788873996.853094:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788873996.853128:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859177088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873996.853173:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.853221:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d33438e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.853237:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177088 00000100:00100000:3.0:1788873996.853241:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177088 00000100:00100000:3.0:1788873996.853269:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788873996.853275:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859177088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788873996.853344:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859177088:12345-0@lo:502:mount.lustre.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.853351:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788873996.853393:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859177088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788873996.853442:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788873996.853450:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788873996.870546:0:19483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788873996.870564:0:19483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d347a793380) 00000020:00000080:0.0:1788873996.870590:0:19483:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788873996.870696:0:19483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d347a75c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788873996.870701:0:19483:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d347a75c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788873996.870705:0:19483:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d347a75c800 3 00010000:00080000:0.0:1788873996.870743:0:19483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d347a75b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.120@tcp at head 00010000:00010000:0.0:1788873996.872495:0:19483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788873996.872683:0:19483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788873996.872724:0:19483:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788873996.872737:0:19483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x25c660afb0a9ca20 00000100:00080000:0.0:1788873996.872747:0:19483:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873996.872753:0:19483:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d347a75b000 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873996.872790:0:19483:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d33441bbb80 x1875769859177216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788873996.872820:0:19483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788873996.873021:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859177216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788873996.873094:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788873996.873199:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873996.873224:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873996.873227:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873996.873230:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873996.873263:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873996.873267:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788873996.873269:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788873996.873274:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1788873996.873279:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788873996.873284:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d33428ea800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:3.0:1788873996.873312:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d347f3a1180 x1875769859177856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788873996.873375:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859177344:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873419:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873443:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859177984:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873465:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873486:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788873996.873492:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859177472:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873514:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873532:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859178112:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873551:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873574:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859177600:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873596:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873615:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859178240:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873635:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873649:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873996.873654:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859177728:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873680:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.873718:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177344 00000100:00100000:3.0:1788873996.873725:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177344 00000100:00100000:3.0:1788873996.873756:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177600 00000100:00100000:3.0:1788873996.873758:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177600 00000100:00100000:3.0:1788873996.873772:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788873996.873781:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859177344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873833:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859177344:12345-0@lo:400:kworker.0 Request processed in 52us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.873847:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788873996.873862:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788873996.873869:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859177600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.873900:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859177600:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.873917:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788873996.873933:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177216 00000100:00100000:3.0:1788873996.873937:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177216 00000100:00100000:3.0:1788873996.873948:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177984 00000100:00100000:3.0:1788873996.873950:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177984 00000100:00100000:3.0:1788873996.873963:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177472 00000100:00100000:3.0:1788873996.873965:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177472 00000100:00100000:3.0:1788873996.873974:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178112 00000100:00100000:3.0:1788873996.873977:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178112 00000100:00100000:3.0:1788873996.873999:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178240 00000100:00100000:3.0:1788873996.874001:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178240 00000100:00100000:3.0:1788873996.874015:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873996.874020:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859177984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874049:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859177984:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.874054:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788873996.874064:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788873996.874069:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859177472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874090:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859177472:12345-0@lo:400:kworker.0 Request processed in 21us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.874095:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788873996.874103:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873996.874116:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859178112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874147:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859178112:12345-0@lo:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.874153:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788873996.874165:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788873996.874171:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859178240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874198:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859178240:12345-0@lo:400:kworker.0 Request processed in 27us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.874225:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788873996.874238:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873996.874242:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859177216:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788873996.874262:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788873996.874294:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x25c660afb0a9ca27 00000004:00100000:3.0:1788873996.874310:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788873996.874341:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9d33428b8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873996.874376:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875769859177216:12345-0@lo:38:llog_process_th.0 Request processed in 133us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.874383:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788873996.874412:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177728 00000100:00100000:3.0:1788873996.874416:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177728 00000100:00100000:3.0:1788873996.874446:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788873996.874452:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859177728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874485:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859177728:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.874490:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788873996.874511:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788873996.874514:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873996.874516:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788873996.874656:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0000 x1875769859177728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873996.874671:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859177728:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874683:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859177600:0@lo:400:kworker.0 00010000:00080000:3.0:1788873996.874692:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a2a00 x1875769859178240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873996.874700:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859178240:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874733:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859177856:0@lo:8:kworker.0 00000100:00100000:3.0:1788873996.874763:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788873996.874801:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33441bbb80 x1875769859177216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788874006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873996.874809:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788873996.874814:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788873996.874821:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788873996.874826:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788873996.874829:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d347a75b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788873996.874834:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1875769859177216:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788873996.874864:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a0380 x1875769859177472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873996.874872:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859177472:0@lo:400:kworker.0 00010000:00080000:3.0:1788873996.874883:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a1c00 x1875769859178112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873996.874898:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859178112:0@lo:400:kworker.0 00000100:00100000:3.0:1788873996.874925:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859177344:0@lo:400:kworker.0 00010000:00080000:3.0:1788873996.874937:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d347f3a2680 x1875769859177984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873996.874944:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859177984:0@lo:400:kworker.0 00000100:00100000:2.0:1788873996.877535:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859177856 00000100:00100000:2.0:1788873996.877550:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859177856 00000100:00100000:2.0:1788873996.877600:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788873996.877610:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1875769859177856:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788873996.877710:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1875769859177856:12345-0@lo:8:kworker.0 Request processed in 101us (2945us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788873996.877718:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788873996.877763:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788873996.877772:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788873996.877776:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788873996.877779:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859177856:0@lo:8:kworker.0 00000020:01000004:0.0:1788873996.878972:0:19483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788873996.878988:0:19483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d347a7919c0) 00000020:00000080:0.0:1788873996.879011:0:19483:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788873996.879098:0:19483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d347a75c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788873996.879103:0:19483:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d347a75c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788873996.879106:0:19483:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d347a75c800 3 00010000:00080000:0.0:1788873996.879138:0:19483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3480d48800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.120@tcp at head 00010000:00010000:0.0:1788873996.885060:0:19483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788873996.885293:0:19483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788873996.885341:0:19483:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788873996.885356:0:19483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x25c660afb0a9ca35 00000100:00080000:0.0:1788873996.885368:0:19483:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788873996.885375:0:19483:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d3480d48800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:0.0:1788873996.887975:0:19483:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d33441ba300 x1875769859178368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788873996.888014:0:19483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788873996.888229:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3632:1875769859178368:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788873996.888303:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788873996.890512:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873996.890520:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788873996.890523:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788873996.890526:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788873996.890667:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178368 00000100:00100000:3.0:1788873996.890677:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178368 00000100:00100000:3.0:1788873996.890721:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788873996.890729:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1875769859178368:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788873996.890761:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788873996.890811:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x25c660afb0a9ca3c 00000004:00100000:3.0:1788873996.890833:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788873996.890873:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9d33428bd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873996.890984:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875769859178368:12345-0@lo:38:llog_process_th.0 Request processed in 254us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.890992:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788873996.892564:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d33441ba300 x1875769859178368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788874006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873996.892579:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788873996.892590:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788873996.892600:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788873996.892613:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788873996.892617:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3480d48800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788873996.892625:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3632:1875769859178368:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788873996.893634:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788873996.893857:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788873996.893889:0:19473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788873996.893931:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca12 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.893943:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d345fd92800/0x25c660afb0a9ca0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca12 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788873996.894005:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788873996.894008:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788873996.894009:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873996.894011:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873996.894012:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873996.894013:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873996.894015:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873996.894017:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873996.894019:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788873996.894023:0:19473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788873996.894026:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788873996.894027:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788873996.894028:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788873996.894029:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788873996.894030:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788873996.894031:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788873996.894032:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788873996.894033:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788873996.894034:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788873996.894062:0:19473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788873996.894084:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859178496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788873996.894154:0:19473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.894199:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34518306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788873996.894246:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178496 00000100:00100000:3.0:1788873996.894254:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178496 00000100:00100000:3.0:1788873996.894297:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788873996.894306:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859178496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788873996.894333:0:17150:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788873996.894356:0:17150:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788873996.908529:0:17150:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788873996.908579:0:17150:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788873996.909147:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:19473:x1875769859178496:12345-0@lo:253:mount.lustre.0 Request processed in 14836us (14987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873996.909160:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788873996.909263:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343991500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a50e61a-7558-480a-b914-36a6e76b41da:19473:1875769859178496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788873996.909277:0:19473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788873996.909280:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788873996.909282:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788873996.909283:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788873996.909285:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788873996.909286:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788873996.909287:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788873996.909289:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788873996.909290:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788873996.909292:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788873996.909306:0:19473:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788873996.910487:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788873996.910494:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788873996.910517:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910534:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910542:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910549:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910593:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910610:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 23 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873996.910624:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859178624:0@lo:104: 00000100:00100000:1.0:1788873996.910677:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788873996.910732:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910759:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 23 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873996.910767:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859178752:0@lo:104: 00000100:00100000:1.0:1788873996.910790:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873996.910808:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d34588733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788873996.910833:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178624 00000100:00100000:1.0:1788873996.910841:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178624 00000100:00100000:1.0:1788873996.910879:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178752 00000100:00100000:1.0:1788873996.910883:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178752 00000100:00100000:1.0:1788873996.910899:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873996.910917:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+4:17171:x1875769859178624:12345-0@lo:104: 00010000:00010000:1.0:1788873996.910930:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.910975:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788873996.910982:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+4:17171:x1875769859178624:12345-0@lo:104: Request processed in 66us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873996.910989:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788873996.911005:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873996.911011:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859178752:12345-0@lo:104: 00010000:00010000:1.0:1788873996.911019:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911049:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788873996.911054:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a50e61a-7558-480a-b914-36a6e76b41da+3:17171:x1875769859178752:12345-0@lo:104: Request processed in 44us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873996.911070:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873996.911102:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859178624:0@lo:104: 00000100:00100000:1.0:1788873996.911110:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1875769859178752:0@lo:104: 00010000:00010000:1.0:1788873996.911128:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911144:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788873996.911149:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911155:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442c00 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873996.911160:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911168:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873996.911175:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873996.911181:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873996.911228:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911235:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873996.911256:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911262:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f442c00/0x25c660afb0a9c9be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c9c5 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911282:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788873996.911285:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911291:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2400 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788873996.911293:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911301:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788873996.911307:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873996.911313:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788873996.911328:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911333:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788873996.911347:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911353:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d33442b2400/0x25c660afb0a9c9b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c9b7 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.911366:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873996.911368:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873996.911369:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788873996.911376:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873996.912987:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859178880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873996.913060:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.913146:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859179008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873996.913171:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873996.913252:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859178880 00000100:00100000:3.0:1788873996.913261:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859178880 00010000:00010000:3.0:1788873996.913296:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 24 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873996.913322:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179008 00000100:00100000:3.0:1788873996.913324:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179008 00010000:00010000:3.0:1788873996.913334:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 25 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788873996.913347:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788873996.913355:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+25:3636:x1875769859178880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788873996.913368:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873996.913374:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 25 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913386:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 25 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873996.913550:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788873996.913559:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788873996.913623:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3343ad9c00/0x25c660afb0a9c9c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c9be expref: 25 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913640:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873996.913681:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+24:3636:x1875769859178880:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.913705:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788873996.913722:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788873996.913729:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+23:3633:x1875769859179008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788873996.913737:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788873996.913742:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 23 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913750:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 23 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913761:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3343ad9800/0x25c660afb0a9c9b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c9b0 expref: 23 pid: 17148 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913772:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913780:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788873996.913793:0:17142:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006491093s 00010000:00010000:3.0:1788873996.913798:0:17142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913805:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913812:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913819:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913832:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788873996.913837:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.913846:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.918726:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873996.918741:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.919171:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.919185:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475ecba00/0x25c660afb0a9ca43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788873996.919227:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788873996.919315:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a50e61a-7558-480a-b914-36a6e76b41da+22:3633:x1875769859179008:12345-0@lo:103:ldlm_bl.0 Request processed in 5582us (6138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873996.919326:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788873996.919511:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859179008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788873996.920050:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859178880:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788873996.923676:0:19473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788873996.930072:0:19473:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788873996.930084:0:19473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788873996.930132:0:19473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788873996.930192:0:19473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788873996.930244:0:19473:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788873996.930267:0:19473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788873996.931053:0:19473:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788873996.931335:0:19473:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788873997.422390:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873997.552388:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873997.552410:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859179136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788873997.552478:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873997.552507:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179136 00000100:00100000:3.0:1788873997.552516:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179136 00000100:00100000:3.0:1788873997.552559:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788873997.552568:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859179136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788873997.552591:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788873997.552643:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859179136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873997.552649:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788873997.552751:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33441ba300 x1875769859179136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873997.552770:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859179136:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788873997.780943:0:19542:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873997.781195:0:19542:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788873997.870886:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788873998.448555:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788873998.574481:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873998.574505:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859179264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873998.574577:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873998.574660:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179264 00000100:00100000:3.0:1788873998.574669:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179264 00000100:00100000:3.0:1788873998.574726:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788873998.574737:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859179264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788873998.574769:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788873998.574851:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859179264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873998.574859:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788873998.575042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859179264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873998.575253:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788873998.575263:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859179392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788873998.575293:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873998.575320:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179392 00000100:00100000:3.0:1788873998.575324:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179392 00000100:00100000:3.0:1788873998.575347:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873998.575354:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859179392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873998.575373:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788873998.576542:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859179392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1184us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873998.576552:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788873998.576605:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859179392:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1788873998.576938:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788873998.576942:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3475f37800 from 10 10000000:01000000:1.0:1788873998.576946:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788873998.576986:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.576998:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.577020:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873998.577040:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873998.577081:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873998.577127:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458873e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788873998.577289:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179520 00000100:00100000:2.0:1788873998.577297:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179520 00000100:00100000:2.0:1788873998.577340:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788873998.577348:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859179520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788873998.577361:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788873998.577373:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33442b3c00/0x25c660afb0a9ca51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9ca4a expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873998.577557:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33442b3c00/0x25c660afb0a9ca51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9ca4a expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873998.577567:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33442b3c00/0x25c660afb0a9ca51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9ca4a expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873998.577576:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33442b3c00, rc 0) 00000100:00100000:2.0:1788873998.577659:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859179520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873998.577666:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788873998.588393:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873998.588425:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca51 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.588437:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9ca51 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873998.588507:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788873998.588576:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873998.588626:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458873e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873998.588698:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179648 00000100:00100000:0.0:1788873998.588705:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179648 00000100:00100000:0.0:1788873998.588757:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788873998.588767:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33440b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859179648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788873998.588787:0:17150:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788873998.588805:0:17150:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788873998.588808:0:17150:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788873998.588906:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33440b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859179648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873998.588915:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788873998.589005:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788873998.589062:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788873998.589069:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca51 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.589078:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb200/0x25c660afb0a9ca4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca51 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788873998.589090:0:17152:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788873998.589093:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3442ab2000 from 10 10000000:01000000:1.0:1788873998.589100:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788873998.589314:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.589325:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.589336:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873998.589351:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788873998.589378:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873998.589433:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458873e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788873998.590539:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179776 00000100:00100000:0.0:1788873998.590555:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179776 00000100:00100000:0.0:1788873998.590595:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788873998.590605:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859179776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788873998.590618:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788873998.590634:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9ca5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9ca58 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873998.590659:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9ca58 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873998.590670:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d345fd93400/0x25c660afb0a9ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9ca58 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788873998.590680:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d345fd93400, rc 0) 00000100:00100000:0.0:1788873998.590801:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859179776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873998.590820:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788873998.591045:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788873998.591064:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca5f expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.591073:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9ca5f expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788873998.591126:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788873998.591159:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873998.591191:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3458873e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788873998.591227:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859179904 00000100:00100000:3.0:1788873998.591233:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859179904 00000100:00100000:3.0:1788873998.591320:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788873998.591330:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859179904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788873998.591357:0:17148:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788873998.591373:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788873998.591376:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788873998.591489:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859179904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873998.591497:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788873998.591513:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859179904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788873998.591566:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788873998.591573:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca5f expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788873998.591589:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb600/0x25c660afb0a9ca58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ca5f expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788873999.471010:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788873999.663309:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788874000.496174:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874001.006499:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873980/real 1788873980] req@ffff9d347f357b80 x1875769859166592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788874000 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.006532:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347f357b80 x1875769859166592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788874000 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.006553:0:3632:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788873980/real 1788873980] req@ffff9d347f356680 x1875769859166720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788874000 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.006565:0:3632:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d347f356680 x1875769859166720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788874000 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788874001.006586:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788874001.006603:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788874001.006607:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859166592:0@lo:8:kworker.0 00000100:00080000:2.0:1788874001.006613:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788874001.006619:0:3632:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788874001.006643:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859166720:0@lo:8:kworker.0 00000100:00080000:2.0:1788874001.006721:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788874001.006725:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788874001.006727:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788874001.006732:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1788874001.006738:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788874001.006745:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3343a88800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788874001.006765:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343886d80 x1875769859180288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788874001.006778:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788874001.006781:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788874001.006782:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788874001.006785:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1788874001.006788:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788874001.006791:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3342b91800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788874001.006802:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343887b80 x1875769859180416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788874001.006838:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788874001.006841:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788874001.006843:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788874001.006847:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d33428ea800 using connection 192.168.202.120@tcp/0@lo 00000100:00100000:2.0:1788874001.006857:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3343884700 x1875769859180928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788874001.006920:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859180032:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.006994:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007029:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859180800:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007055:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007074:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859181440:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007098:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007116:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788874001.007121:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859180160:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007141:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007156:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859181056:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007172:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007185:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859181568:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007201:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007242:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859180544:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007263:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007272:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859181184:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007286:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007294:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788874001.007299:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859180672:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007327:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007343:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859181312:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007484:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.007512:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180032 00000100:00100000:2.0:1788874001.007520:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180032 00000100:00100000:2.0:1788874001.007573:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788874001.007583:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:3633:x1875769859180032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007635:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:3633:x1875769859180032:12345-0@lo:400:kworker.0 Request processed in 53us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.007642:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788874001.007670:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180800 00000100:00100000:2.0:1788874001.007674:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180800 00000100:00100000:2.0:1788874001.007705:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788874001.007711:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859180800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007740:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859180800:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.007745:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788874001.007762:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181440 00000100:00100000:2.0:1788874001.007766:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181440 00000100:00100000:2.0:1788874001.007785:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181056 00000100:00100000:2.0:1788874001.007788:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181056 00000100:00100000:2.0:1788874001.007798:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181568 00000100:00100000:2.0:1788874001.007800:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181568 00000100:00100000:2.0:1788874001.007810:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180544 00000100:00100000:2.0:1788874001.007812:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180544 00000100:00100000:2.0:1788874001.007820:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181184 00000100:00100000:2.0:1788874001.007821:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181184 00000100:00100000:2.0:1788874001.007831:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181312 00000100:00100000:2.0:1788874001.007834:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181312 00000100:00100000:2.0:1788874001.007844:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788874001.007849:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859181440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007890:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875769859181440:12345-0@lo:400:kworker.0 Request processed in 40us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.007896:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788874001.007907:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788874001.007913:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859181056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007948:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859181056:12345-0@lo:400:kworker.0 Request processed in 36us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.007954:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788874001.007964:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788874001.007969:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859181568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.007992:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875769859181568:12345-0@lo:400:kworker.0 Request processed in 23us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.007998:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788874001.008008:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788874001.008014:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859180544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.008062:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875769859180544:12345-0@lo:400:kworker.0 Request processed in 47us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.008067:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788874001.008077:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788874001.008082:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859181184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.008104:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875769859181184:12345-0@lo:400:kworker.0 Request processed in 22us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.008110:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788874001.008120:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788874001.008125:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859181312:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788874001.008139:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885f80 x1875769859180544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.008146:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859181312:12345-0@lo:400:kworker.0 Request processed in 22us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.008151:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788874001.008153:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875769859180544:0@lo:400:kworker.0 00010000:00080000:3.0:1788874001.008164:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886680 x1875769859181184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.008170:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180160 00000100:00100000:3.0:1788874001.008172:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1875769859181184:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.008174:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180160 00010000:00080000:3.0:1788874001.008191:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884e00 x1875769859181312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.008194:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180672 00000100:00100000:2.0:1788874001.008196:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180672 00000100:00100000:3.0:1788874001.008199:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859181312:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.008223:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788874001.008228:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859180160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.008259:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859180160:12345-0@lo:400:kworker.0 Request processed in 31us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.008265:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788874001.008276:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788874001.008281:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859180672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.008316:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859180672:12345-0@lo:400:kworker.0 Request processed in 34us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.008322:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788874001.008351:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788874001.008372:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859180672:0@lo:400:kworker.0 00000100:00080000:2.0:1788874001.008614:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788874001.008618:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788874001.008751:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859180288:0@lo:8:kworker.0 00000100:00100000:2.0:1788874001.008788:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.008831:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859180416:0@lo:8:kworker.0 00000100:00100000:2.0:1788874001.008857:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.008890:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859180928:0@lo:8:kworker.0 00000100:00100000:1.0:1788874001.008911:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180288 00000100:00100000:2.0:1788874001.008912:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874001.008916:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180288 00000100:00100000:1.0:1788874001.008936:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180416 00000100:00100000:1.0:1788874001.008939:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180416 00000100:00100000:2.0:1788874001.008940:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859180928 00000100:00100000:2.0:1788874001.008942:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859180928 00000100:00100000:1.0:1788874001.008950:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788874001.008954:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874001.008955:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3632:x1875769859180288:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788874001.008958:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3632:x1875769859180416:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788874001.008984:0:18663:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788874001.009018:0:18663:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9ca66 00002000:00100000:1.0:1788874001.009036:0:18663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d3342ac8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788874001.009041:0:18663:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788874001.009046:0:18663:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1788874001.009127:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00002000:00080000:1.0:1788874001.009131:0:18663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1788874001.009142:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c660afb0a9ca6d 00000100:00080000:1.0:1788874001.009152:0:18663:0:(import.c:65:import_set_state_nolock()) ffff9d3342acc000 : changing import state from RECOVER to FULL 00002000:00100000:2.0:1788874001.009156:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d3341e82000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788874001.009158:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788874001.009161:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788874001.009200:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3632:x1875769859180288:12345-0@lo:8:kworker.0 Request processed in 245us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874001.009381:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788874001.009395:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788874001.009399:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3632:x1875769859180928:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788874001.009414:0:18663:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788874001.009430:0:18663:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c660afb0a9ca74 00002000:00100000:1.0:1788874001.009435:0:18663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d3342acb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788874001.009438:0:18663:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788874001.009445:0:18663:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788874001.009465:0:18663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788874001.009477:0:18663:0:(import.c:65:import_set_state_nolock()) ffff9d3342acf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788874001.009504:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3632:x1875769859180928:12345-0@lo:8:kworker.0 Request processed in 103us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874001.009509:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00002000:00080000:2.0:1788874001.009966:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788874001.009982:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9d3341e86800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788874001.010012:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875769859180416:12345-0@lo:8:kworker.0 Request processed in 1052us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.010018:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788874001.010059:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859180160:0@lo:400:kworker.0 00010000:00080000:2.0:1788874001.010073:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343885180 x1875769859181056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.010083:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859181056:0@lo:400:kworker.0 00010000:00080000:2.0:1788874001.010093:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886a00 x1875769859181568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.010100:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1875769859181568:0@lo:400:kworker.0 00000100:00100000:2.0:1788874001.010109:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859180032:0@lo:400:kworker.0 00010000:00080000:2.0:1788874001.010120:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343887480 x1875769859180800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.010127:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859180800:0@lo:400:kworker.0 00010000:00080000:2.0:1788874001.010137:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886300 x1875769859181440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.010145:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1875769859181440:0@lo:400:kworker.0 00010000:00080000:3.0:1788874001.010559:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886d80 x1875769859180288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788874026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874001.010567:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788874001.010575:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788874001.010583:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788874001.010588:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788874001.010590:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3343a88800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788874001.010602:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788874001.010614:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859180288:0@lo:8:kworker.0 00010000:00080000:3.0:1788874001.010639:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343887b80 x1875769859180416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788874026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874001.010646:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788874001.010650:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788874001.010656:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788874001.010659:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788874001.010661:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d3342b91800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788874001.010673:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788874001.010677:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1875769859180416:0@lo:8:kworker.0 00010000:00080000:3.0:1788874001.010690:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343884700 x1875769859180928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788874026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788874001.010699:0:3632:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788874001.010703:0:3632:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788874001.010706:0:3632:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788874001.010708:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9d33428ea800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788874001.010720:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788874001.010723:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1875769859180928:0@lo:8:kworker.0 00000004:00080000:3.0:1788874001.010774:0:17182:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788874001.010792:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343884700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1875769859181824:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788874001.010822:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874001.010847:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343867840 going to sleep for 11 seconds 00000004:00080000:3.0:1788874001.010873:0:17181:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788874001.010937:0:17181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 537956732176ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788874001.010944:0:17181:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788874001.010975:0:17899:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788874001.010995:0:17899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17899:1875769859182080:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788874001.011018:0:17899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874001.011033:0:17899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343867180 going to sleep for 11 seconds 00000004:00080000:3.0:1788874001.011045:0:17898:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788874001.011084:0:17898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 537956879281ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788874001.011089:0:17898:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788874001.011108:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181824 00000100:00100000:3.0:1788874001.011113:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181824 00000100:00100000:3.0:1788874001.011145:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182080 00000100:00100000:3.0:1788874001.011148:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182080 00000100:00100000:3.0:1788874001.011163:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788874001.011170:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17182:x1875769859181824:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788874001.011669:0:17180:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788874001.011690:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1875769859182336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788874001.011716:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.011726:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874001.011738:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788874001.011746:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859182208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788874001.011768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.011792:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182208 00000100:00100000:2.0:1788874001.011795:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182208 00000100:00100000:2.0:1788874001.011822:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874001.011827:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1875769859182208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788874001.011845:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788874001.012092:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859181696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788874001.012118:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874001.012134:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788874001.012139:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859181952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788874001.012154:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874001.012173:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182336 00000100:00100000:3.0:1788874001.012176:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182336 00000100:00100000:3.0:1788874001.012193:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788874001.012199:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17899:x1875769859182080:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788874001.013451:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3634:x1875769859182208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1614us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.013463:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874001.013488:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181696 00000100:00100000:2.0:1788874001.013494:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181696 00000100:00100000:2.0:1788874001.013513:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859181952 00000100:00100000:2.0:1788874001.013516:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859181952 00000100:00100000:2.0:1788874001.013531:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788874001.013538:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875769859181696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788874001.013576:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788874001.013860:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875769859181696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 321us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.013878:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788874001.013896:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788874001.013903:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1875769859181952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788874001.013914:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788874001.013946:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1875769859181952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.013953:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788874001.013986:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788874001.013990:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788874001.014031:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886d80 x1875769859181952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.014055:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859181952:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788874001.014069:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343992a00 x1875769859181696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874001.014082:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859181696:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788874001.014423:0:17179:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788874001.014502:0:17179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 537960296758ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788874001.014510:0:17179:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1788874001.016335:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343bbed80 x1875769859182208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874001.016359:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859182208:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788874001.024937:0:18663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788874001.024950:0:18663:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788874001.025069:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17899:x1875769859182080:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12864us (14044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874001.025081:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788874001.025117:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788874001.025130:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17180:x1875769859182336:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1788874001.025520:0:17899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886300 x1875769859182080/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788874017 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874001.025564:0:17899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17899:1875769859182080:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788874001.025583:0:17899:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788874001.025632:0:17899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17899:1875769859182464:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788874001.025672:0:17899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874001.025708:0:17899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343867180 going to sleep for 11 seconds 00000100:00100000:3.0:1788874001.025727:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788874001.025734:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788874001.025843:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182464 00000100:00100000:3.0:1788874001.025849:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182464 00000100:00100000:3.0:1788874001.025973:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874001.025981:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17899:x1875769859182464:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788874001.026000:0:19728:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788874001.026038:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17899:x1875769859182464:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874001.026044:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788874001.026070:0:17899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343886300 x1875769859182464/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874017 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874001.026080:0:17899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17899:1875769859182464:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788874001.026090:0:17899:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788874001.026116:0:17899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17899:1875769859182592:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788874001.026142:0:17899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874001.026157:0:17899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343867180 going to sleep for 11 seconds 00000100:00100000:3.0:1788874001.026169:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182592 00000100:00100000:3.0:1788874001.026172:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182592 00000100:00100000:3.0:1788874001.026189:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788874001.026217:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17899:x1875769859182592:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788874001.026244:0:18662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1788874001.026942:0:19195:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788874001.026949:0:19195:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788874001.026954:0:19195:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:0.0:1788874001.027347:0:18663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788874001.027410:0:18663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788874001.027415:0:18663:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:2.0:1788874001.039393:0:17135:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788874001.039594:0:17888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788874001.040696:0:17135:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788874001.052572:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788874001.052584:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.052602:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1788874001.052606:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.052612:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.053786:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.053806:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.053816:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.053952:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788874001.053964:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874001.053970:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.053990:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788874001.053995:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.054004:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.054019:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.054026:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9ca7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.054044:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.054046:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.054047:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.055820:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.055832:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.055848:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.055853:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.055859:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788874001.056186:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.056193:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.056450:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.056454:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.056459:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057013:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057027:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057036:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057096:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788874001.057108:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.057115:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057134:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca000 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.057140:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057150:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057166:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057174:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d18b399f/0x25c660afb0a9ca89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057191:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.057193:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.057194:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.057921:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.057931:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.057941:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057943:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.057951:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.057961:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.057963:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.057982:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.057983:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058003:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058011:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.058015:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788874001.058028:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788874001.058037:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788874001.058042:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058050:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.058053:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058062:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058077:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058085:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5993df8/0x25c660afb0a9ca82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058103:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.058112:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058119:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.058122:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058131:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058142:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058148:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64e6799/0x25c660afb0a9ca90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058159:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.058161:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.058163:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.058388:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.058616:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.058633:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.058643:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.058646:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.058651:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.059123:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.059136:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.059144:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.059167:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788874001.059198:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.059326:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.059333:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059342:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.059346:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059379:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059394:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059402:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060f77c45/0x25c660afb0a9ca97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059420:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.059422:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.059424:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.059488:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.059498:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1788874001.059502:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.059507:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.059518:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.059532:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.059539:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.059558:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.059700:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.059705:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059713:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.059717:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059725:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059736:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059756:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9ca9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.059770:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.059772:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.059774:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.060084:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.060091:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788874001.060094:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788874001.060106:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.060106:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.060113:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.060121:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.060122:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.060129:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.060139:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.060141:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.060162:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.060163:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.060181:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.060230:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.060237:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.061536:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788874001.061543:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788874001.061554:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061564:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.061569:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061581:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061600:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061608:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e93eb12/0x25c660afb0a9caa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061631:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.061635:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061650:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.061654:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061663:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061674:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.061682:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.061684:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.061685:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.061935:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788874001.061942:0:19195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b1bc1c2/0x25c660afb0a9caac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788874001.062498:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788874001.062505:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.062514:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1788874001.062517:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.062521:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.062529:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.062535:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.062540:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062577:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.062583:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062588:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.062591:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062597:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062606:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062618:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.062619:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.062622:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.062680:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:1.0:1788874001.062683:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788874001.062685:0:19195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000808a8d50/0x25c660afb0a9cab3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.062693:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.062708:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.062713:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.062717:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.062729:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.062737:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.062746:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062929:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.062936:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062945:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.062949:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062957:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062969:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.062978:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.062980:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.062982:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788874001.063058:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788874001.063064:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063073:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1788874001.063076:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.063080:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063089:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063096:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063102:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063119:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.063149:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.063158:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788874001.063162:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063165:0:18663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a29a38/0x25c660afb0a9caba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063182:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443c00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.063186:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063227:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063311:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063320:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e137ace8/0x25c660afb0a9cac1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063336:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.063338:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.063340:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.063347:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788874001.063629:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788874001.063635:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063643:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1788874001.063646:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874001.063657:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063667:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063688:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063695:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.063712:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788874001.063743:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.063748:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063756:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.063759:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063767:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063779:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063787:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c930c04c/0x25c660afb0a9cac8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063800:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.063802:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.063804:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.063841:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.063846:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063854:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.063861:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.063876:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063886:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063894:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063901:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.063914:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.063924:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.063929:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063936:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.063940:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063948:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063959:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063971:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4b0739f/0x25c660afb0a9cacf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.063987:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.064225:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.064228:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.064364:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.064370:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064379:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.064383:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.064387:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064396:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064404:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064417:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064432:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788874001.064440:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.064444:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064452:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecaa00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.064455:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064462:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064474:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064481:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f175d3b/0x25c660afb0a9cad6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064493:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.064494:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.064496:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.064513:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.064519:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.064527:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.064530:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.064535:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.064544:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.064552:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.064559:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.064607:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788874001.064808:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874001.064813:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.064821:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788874001.064825:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.064833:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.064845:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.064875:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cadd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788874001.064878:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.064890:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.064894:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.064896:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.064897:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.064898:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.064902:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.064906:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064916:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064925:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064933:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.064959:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788874001.065225:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874001.065230:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.065236:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dea00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788874001.065238:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.065255:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.065268:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.065276:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006127d1fb/0x25c660afb0a9cae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874001.065294:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.065296:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.065298:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.065494:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.065506:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.065515:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.065519:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.065523:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.065534:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.065543:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.065549:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.065658:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788874001.065957:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.065964:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.065973:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.065977:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.065984:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066096:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066103:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d13dfea/0x25c660afb0a9caeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066118:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.066120:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.066122:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.066141:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.066147:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.066155:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=538s v=(0 0) 00002000:00010000:1.0:1788874001.066158:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.066158:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.066163:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.066163:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066171:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.066174:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.066174:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066177:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066187:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.066188:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066195:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.066196:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066225:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.066225:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788874001.066278:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788874001.066285:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788874001.066289:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066297:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.066300:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066308:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066318:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066326:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002dcc2a8/0x25c660afb0a9caf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066339:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874001.066342:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066349:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874001.066351:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066369:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066379:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066385:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef6f0b1/0x25c660afb0a9caf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.066398:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.066400:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874001.066402:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.067371:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.067380:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.067392:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.067396:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.067401:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.067412:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.067419:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.067433:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.067455:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.067907:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.067915:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.067923:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434df000 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.067927:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.067936:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.067950:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.067959:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b0352fc/0x25c660afb0a9cb00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.067975:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.067984:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.067987:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.068083:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788874001.068084:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.068095:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068096:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.068121:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.068122:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.068131:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.068132:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.068140:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.068141:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068163:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068179:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068185:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.068189:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068200:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.068201:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068231:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.068232:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068238:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.068251:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.068306:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dec00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.068309:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068317:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068328:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068336:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f502bb42/0x25c660afb0a9cb0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068350:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.068354:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068360:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.068364:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068382:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068393:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068399:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068412:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.068414:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.068416:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.068423:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.068612:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.068616:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068627:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.068629:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.068632:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068638:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068643:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068648:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.068660:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.068687:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.068691:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068699:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.068703:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068711:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068722:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068735:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b068cbd/0x25c660afb0a9cb15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.068749:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.068751:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.068752:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.069456:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.069462:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069469:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.069472:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.069475:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069481:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069509:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069518:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069534:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.069541:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.069546:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.069554:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.069557:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.069565:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.069575:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.069583:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ef6f0b1/0x25c660afb0a9cb1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.069596:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.069598:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.069600:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.069937:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.069943:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069950:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.069952:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.069956:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069964:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069971:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.069979:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.070021:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.070275:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.070281:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070289:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434df800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.070293:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070301:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070313:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070320:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530b3e9d/0x25c660afb0a9cb23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070334:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.070336:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.070337:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788874001.070566:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788874001.070572:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.070581:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788874001.070584:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874001.070588:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.070596:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.070603:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.070609:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874001.070629:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.070917:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.070924:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070931:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dfc00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.070935:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070953:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070965:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.070973:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2243ac2/0x25c660afb0a9cb2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.071000:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.071002:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.071004:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.071150:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.074541:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.074553:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074571:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.074576:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.074583:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074598:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074610:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074645:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074665:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.074677:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.074682:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074691:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.074696:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074706:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074724:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074733:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.074756:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.074758:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.074761:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.075530:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.075546:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075558:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.075561:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.075566:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075576:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075586:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075594:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075610:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788874001.075883:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.075889:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075897:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.075900:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.075904:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075913:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075927:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075935:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.075957:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788874001.076250:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.076256:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076265:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.076268:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.076272:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076281:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076288:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076296:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076321:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788874001.076330:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788874001.076335:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076343:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.076347:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076356:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076370:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076379:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f806164c/0x25c660afb0a9cb38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076396:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788874001.076399:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076404:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.076407:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076427:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076438:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076445:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d27342e5/0x25c660afb0a9cb3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076457:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.076460:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076466:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2c00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.076469:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076475:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076483:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076490:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d5b204/0x25c660afb0a9cb46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076510:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.076511:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.076513:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.076764:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.076770:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076777:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.076780:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.076784:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076794:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076802:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076809:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076822:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.076829:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.076832:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076849:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.076852:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076859:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076885:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076892:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3b733e/0x25c660afb0a9cb4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.076907:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.076909:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.076910:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.077115:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.078196:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.078279:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.078286:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.078300:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.078304:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.078309:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.078321:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.078330:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.078344:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.078367:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788874001.079003:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.079010:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.079020:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.079024:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.079028:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.079038:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.079046:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.079053:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.079490:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788874001.079505:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788874001.079511:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079520:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.079524:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079534:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079557:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079565:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adbb12f6/0x25c660afb0a9cb54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079583:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.079586:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079592:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93c00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.079596:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079603:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079613:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079620:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea60f7b/0x25c660afb0a9cb5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079632:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.079634:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.079641:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.079817:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.079823:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079832:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.079835:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.079839:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079849:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079856:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079875:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.079893:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.080313:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.080319:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788874001.080323:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.080329:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080333:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.080336:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080337:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.080340:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.080344:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080346:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080358:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080365:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c0e40/0x25c660afb0a9cb62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080370:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080378:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080379:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.080381:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.080383:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.080386:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080399:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.080405:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.080410:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080416:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2600 already unused, calling callback (ffffffffc0e3f4f0) 00002000:00010000:0.0:1788874001.080419:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.080420:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080424:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080428:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080432:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.080435:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.080439:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080440:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080447:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf651b7/0x25c660afb0a9cb69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080450:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080462:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080466:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.080468:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.080470:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.080470:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080481:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.080488:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.080491:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080498:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.080501:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080508:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080519:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080526:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000664d3857/0x25c660afb0a9cb70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.080538:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.080544:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.080546:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.080923:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.080929:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080938:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.080940:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.080944:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080952:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080959:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080967:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.080980:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.080988:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.080992:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081010:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.081014:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081021:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081032:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081040:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000587770b0/0x25c660afb0a9cb77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081054:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.081056:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.081058:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.081412:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.081418:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081426:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.081429:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.081433:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081442:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081455:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081462:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081477:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.081485:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.081489:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081496:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.081499:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081506:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081517:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081524:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118b720b/0x25c660afb0a9cb7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.081536:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.081544:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.081546:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788874001.081918:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788874001.081944:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788874001.081949:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788874001.082089:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.082095:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082103:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.082107:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.082111:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082120:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082129:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082137:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082150:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.082158:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.082162:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082179:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.082183:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082191:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082218:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082227:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006537c013/0x25c660afb0a9cb85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.082241:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.082243:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.082245:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.082664:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.082671:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082679:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.082682:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.082686:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082696:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082704:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082711:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082727:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.082735:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.082740:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082747:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.082750:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082769:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082780:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082787:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002dcc2a8/0x25c660afb0a9cb8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.082801:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.082803:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.082804:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.083092:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.083098:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083107:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.083111:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.083114:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083124:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083139:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083145:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083158:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788874001.083166:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874001.083171:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083177:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b3200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874001.083180:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083187:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083198:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083226:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9dc0337/0x25c660afb0a9cb93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.083240:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.083248:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.083249:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.083577:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.083583:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083591:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.083594:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.083599:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083608:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083615:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083633:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083650:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788874001.083909:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.083914:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083922:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.083925:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.083929:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083939:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083946:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083952:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083967:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788874001.083975:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788874001.083979:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.083992:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93800 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.083995:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084003:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084015:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084021:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d13dfea/0x25c660afb0a9cb9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084037:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.084040:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084046:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.084049:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084056:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084064:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084077:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5993df8/0x25c660afb0a9cba1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084089:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.084091:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.084093:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.084259:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.084509:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.084515:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084523:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.084526:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.084530:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084540:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084547:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084554:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084566:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.084573:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.084583:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084589:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.084592:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084599:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084610:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084617:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b2da8e/0x25c660afb0a9cba8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084630:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.084632:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.084633:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.084939:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.084945:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084953:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.084956:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.084960:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084979:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084987:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.084995:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.085009:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.085016:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.085020:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.085028:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.085031:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.085039:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.085050:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.085057:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002972acfc/0x25c660afb0a9cbaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.085077:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.085079:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.085081:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.085304:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874001.085461:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17899:x1875769859182592:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59255us (59314us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788874001.085472:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788874001.088495:0:17899:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788874001.088511:0:17899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343886300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17899:1875769859182592:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788874001.088528:0:17899:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788874001.088585:0:17899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17899:1875769859182720:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788874001.088641:0:17899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874001.088672:0:17899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874001.088701:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182720 00000100:00100000:0.0:1788874001.088706:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182720 00000100:00100000:0.0:1788874001.088754:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874001.088763:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17899:x1875769859182720:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788874001.088807:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17899:x1875769859182720:12345-0@lo:900:osp-pre-1-1.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874001.088814:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788874001.088844:0:17899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d33441b8700 x1875769859182720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788874017 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874001.088855:0:17899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17899:1875769859182720:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788874001.089162:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.089168:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089182:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.089192:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.089197:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089232:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089241:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089246:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089257:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.089266:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.089270:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089275:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd93a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.089278:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089284:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089295:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089308:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000688a3188/0x25c660afb0a9cbb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089322:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.089323:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.089324:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.089749:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.089755:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089763:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.089766:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.089770:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089779:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089787:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089793:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089807:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.089815:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.089825:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089831:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.089834:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089842:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089853:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089860:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053413310/0x25c660afb0a9cbbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.089886:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.089888:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.089890:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.090153:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.090158:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090164:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.090166:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.090169:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090183:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090188:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090192:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090222:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788874001.090469:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.090473:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090479:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.090481:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.090483:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090489:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090494:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090506:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090515:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788874001.090521:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788874001.090524:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090529:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92000 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.090531:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090536:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090543:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090547:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be746597/0x25c660afb0a9cbc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090557:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.090559:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090570:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d345fd92a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.090572:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090577:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090582:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090586:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a7327a6/0x25c660afb0a9cbcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090594:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.090595:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.090596:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788874001.090782:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.090786:0:19195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090792:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1788874001.090794:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874001.090797:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090803:0:19195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090811:0:19195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090815:0:19195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090824:0:19195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.090829:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.090832:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090836:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3341e25400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.090838:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090843:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090850:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090854:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6b70d91/0x25c660afb0a9cbd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.090875:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.090882:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.090884:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788874001.090921:0:19195:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788874001.091008:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17182:x1875769859181824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79834us (80181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874001.091017:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788874001.091072:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343884700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1875769859181824:0@lo:5:osp-pre-1-0.0 00002000:00010000:2.0:1788874001.091075:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.091082:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788874001.091087:0:17182:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00010000:00010000:2.0:1788874001.091089:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.091093:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.091097:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091106:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091114:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091120:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874001.091131:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1875769859182848:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788874001.091133:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788874001.091163:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874001.091183:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3476dcfe40 going to sleep for 11 seconds 00010000:00010000:0.0:1788874001.091194:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.091197:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091237:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652600 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.091240:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091248:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091259:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091268:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000212be891/0x25c660afb0a9cbd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091289:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.091291:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.091293:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874001.091304:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182848 00000100:00100000:0.0:1788874001.091309:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182848 00000100:00100000:0.0:1788874001.091501:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788874001.091511:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17182:x1875769859182848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788874001.091545:0:19195:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:2.0:1788874001.091547:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.091551:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091559:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.091562:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.091572:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091582:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091591:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091598:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091615:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.091817:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.091822:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788874001.091827:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788874001.091830:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653200 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.091833:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091841:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091846:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091853:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091854:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.091857:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.091869:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091869:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d3697b3/0x25c660afb0a9cbe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091880:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091885:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.091888:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091892:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.091894:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874001.091903:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.091921:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.091923:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.091927:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091935:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.091938:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091946:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091957:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091964:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c63fb7/0x25c660afb0a9cbe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.091977:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.091978:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.091980:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.092451:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.092457:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.092465:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.092468:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.092472:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.092481:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.092488:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.092494:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.092511:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788874001.092768:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.092773:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.092780:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.092783:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.092799:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.092811:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.092819:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acafb622/0x25c660afb0a9cbee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.092835:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.092837:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.092839:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874001.093086:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788874001.093782:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788874001.093791:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.093809:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1788874001.093812:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788874001.093817:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.093827:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.093837:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.093845:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874001.093875:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788874001.093922:0:18663:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788874001.094841:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17180:x1875769859182336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 69711us (83119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874001.094853:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788874001.094924:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1875769859182336:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788874001.094939:0:17180:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788874001.094984:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1875769859182976:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788874001.095035:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874001.095062:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d344f488f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874001.095087:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859182976 00000100:00100000:2.0:1788874001.095093:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859182976 00000100:00100000:2.0:1788874001.095131:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788874001.095139:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1875769859182976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788874001.095174:0:18662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:3.0:1788874001.095231:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17182:x1875769859182848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3721us (4066us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788874001.095239:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788874001.095327:0:17909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874001.095335:0:17909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.095346:0:17909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653a00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:0.0:1788874001.095351:0:17909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.095360:0:17909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.095377:0:17909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.095397:0:17909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801e2fcf/0x25c660afb0a9cbf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874001.095420:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.095422:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874001.095424:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874001.095449:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1875769859182848:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788874001.095458:0:17182:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:0.0:1788874001.111335:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788874001.112479:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788874001.112647:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17180:x1875769859182976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17503us (17606us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788874001.112659:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788874001.112709:0:17180:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788874001.112716:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1875769859182976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788874001.112731:0:17180:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1788874001.526102:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874002.542609:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874002.671494:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859183104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788874002.671658:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874002.671726:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183104 00000100:00100000:0.0:1788874002.671734:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183104 00000100:00100000:0.0:1788874002.671782:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874002.671840:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859183104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788874002.671882:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788874002.671927:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859183104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874002.671933:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874002.671988:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859183104:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1788874003.117581:0:19832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg220-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788874003.566596:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874003.694389:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859183232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788874003.694465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874003.694855:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183232 00000100:00100000:1.0:1788874003.694865:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183232 00000100:00100000:1.0:1788874003.694924:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788874003.694934:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859183232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788874003.694970:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788874003.695041:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859183232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874003.695048:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788874003.695094:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859183232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788874003.695367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859183360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788874003.695398:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874003.695476:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183360 00000100:00100000:0.0:1788874003.695481:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183360 00000100:00100000:0.0:1788874003.695513:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788874003.695521:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859183360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788874003.695781:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788874003.695832:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859183360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 311us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874003.695849:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788874003.695973:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859183360:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788874004.272083:0:19885:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788874004.272325:0:19885:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788874004.591611:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788874005.066058:0:19935:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788874005.066262:0:19935:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788874005.423835:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.424009:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840224640 00000100:00100000:3.0:1788874005.424020:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840224640 00000100:00100000:3.0:1788874005.424089:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 112 00000100:00100000:3.0:1788874005.424098:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1875769840224640:12345-192.168.202.20@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788874005.424128:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 24a1c553-66f3-4674-b9cc-0bbc78015451@192.168.202.20@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1788874005.424159:0:17148:0:(genops.c:1385:class_connect()) connect: client 24a1c553-66f3-4674-b9cc-0bbc78015451, cookie 0x25c660afb0a9cbfc 00000100:00080000:3.0:1788874005.424755:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d3344250800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788874005.424836:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+5:2397:x1875769840224640:12345-192.168.202.20@tcp:250:mount.lustre.0 Request processed in 737us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.424847:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 112 00000100:00100000:2.0:1788874005.428781:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.429248:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840224768 00000100:00100000:0.0:1788874005.429259:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840224768 00000100:00100000:0.0:1788874005.429327:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 113 00000100:00100000:0.0:1788874005.429337:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+5:14902:x1875769840224768:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788874005.429353:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874005.429372:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3341e24a00/0x25c660afb0a9cc03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a99c4 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874005.429403:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3341e24a00/0x25c660afb0a9cc03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99c4 expref: 6 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874005.429445:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3341e24a00/0x25c660afb0a9cc03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99c4 expref: 6 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874005.429457:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3341e24a00, rc 0) 00000100:00100000:0.0:1788874005.429952:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+6:14902:x1875769840224768:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 614us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.429961:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 113 00000100:00100000:1.0:1788874005.436746:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874005.437000:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840224896 00000100:00100000:2.0:1788874005.437012:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840224896 00000100:00100000:3.0:1788874005.437640:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:3.0:1788874005.437655:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+6:14902:x1875769840224896:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788874005.437800:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+6:14902:x1875769840224896:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 149us (1067us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788874005.437809:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 114 00000100:00100000:2.0:1788874005.453751:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.454648:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225024 00000100:00100000:0.0:1788874005.454660:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225024 00000100:00100000:0.0:1788874005.454726:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 115 00000100:00100000:0.0:1788874005.454738:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+6:14902:x1875769840225024:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788874005.454755:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874005.454774:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3341e24400/0x25c660afb0a9cc0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a99cb expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874005.454804:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3341e24400/0x25c660afb0a9cc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99cb expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874005.454816:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3341e24400/0x25c660afb0a9cc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99cb expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874005.454834:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3341e24400, rc 0) 00000100:00100000:0.0:1788874005.454970:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+7:14902:x1875769840225024:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 234us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.454978:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 115 00000100:00100000:2.0:1788874005.479852:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.480159:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225152 00000100:00100000:3.0:1788874005.480170:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225152 00000100:00100000:3.0:1788874005.480272:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 116 00000100:00100000:3.0:1788874005.480284:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+7:14902:x1875769840225152:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788874005.480466:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442f34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14902:x1875769840225152:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 185us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.480474:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 116 00000100:00100000:1.0:1788874005.484302:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.484349:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225280 00000100:00100000:3.0:1788874005.484362:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225280 00000100:00100000:3.0:1788874005.484417:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 117 00000100:00100000:3.0:1788874005.484428:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14902:x1875769840225280:12345-192.168.202.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788874005.484590:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14902:x1875769840225280:12345-192.168.202.20@tcp:503:mount.lustre.0 Request processed in 164us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.484599:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 117 00000100:00100000:2.0:1788874005.491903:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.492442:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225408 00000100:00100000:0.0:1788874005.492471:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225408 00000100:00100000:0.0:1788874005.492542:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 118 00000100:00100000:0.0:1788874005.492553:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3442dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14920:x1875769840225408:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788874005.492917:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3442dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14920:x1875769840225408:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 365us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.492925:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 118 00000100:00100000:2.0:1788874005.542684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874005.542899:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225536 00000100:00100000:1.0:1788874005.542910:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225536 00000100:00100000:1.0:1788874005.543020:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 119 00000100:00100000:1.0:1788874005.543041:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14920:x1875769840225536:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788874005.543240:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14920:x1875769840225536:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 177us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874005.543248:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 119 00000100:00100000:1.0:1788874005.553051:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.554162:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225664 00000100:00100000:0.0:1788874005.554178:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225664 00000100:00100000:0.0:1788874005.554279:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 120 00000100:00100000:0.0:1788874005.554289:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14920:x1875769840225664:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788874005.554463:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14920:x1875769840225664:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 175us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.554471:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 120 00000100:00100000:2.0:1788874005.563506:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874005.564154:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225792 00000100:00100000:1.0:1788874005.564165:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225792 00000100:00100000:1.0:1788874005.564392:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 121 00000100:00100000:1.0:1788874005.564402:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+8:14902:x1875769840225792:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788874005.564417:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874005.564432:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33434df400/0x25c660afb0a9cc11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a99fc expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874005.564457:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33434df400/0x25c660afb0a9cc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99fc expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874005.564484:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33434df400/0x25c660afb0a9cc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a99fc expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874005.564494:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434df400, rc 0) 00000100:00100000:1.0:1788874005.564558:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+9:14902:x1875769840225792:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 158us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874005.564565:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 121 00000100:00100000:2.0:1788874005.567639:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.567703:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840225920 00000100:00100000:3.0:1788874005.567712:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840225920 00000100:00100000:3.0:1788874005.567760:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:3.0:1788874005.567767:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+9:14902:x1875769840225920:12345-192.168.202.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788874005.567787:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788874005.567830:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788874005.567840:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788874005.567843:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788874005.567846:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788874005.567849:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788874005.569281:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+9:14902:x1875769840225920:12345-192.168.202.20@tcp:256:mount.lustre.0 Request processed in 1507us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.569291:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 122 00000100:00100000:2.0:1788874005.572537:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874005.572679:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226048 00000100:00100000:1.0:1788874005.572689:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226048 00000100:00100000:1.0:1788874005.572805:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 123 00000100:00100000:1.0:1788874005.572817:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+9:14902:x1875769840226048:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788874005.572847:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874005.572871:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9a03 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874005.572905:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874005.572917:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874005.572927:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434de600, rc 0) 00000100:00100000:1.0:1788874005.572983:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14902:x1875769840226048:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 169us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874005.572990:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 123 00000100:00100000:2.0:1788874005.575409:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.575743:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226176 00000100:00100000:3.0:1788874005.575753:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226176 00000100:00100000:3.0:1788874005.575925:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 124 00000100:00100000:3.0:1788874005.575938:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14902:x1875769840226176:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788874005.576105:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14902:x1875769840226176:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 170us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.576113:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 124 00000100:00100000:2.0:1788874005.577812:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874005.577905:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226304 00000100:00100000:1.0:1788874005.577928:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226304 00000100:00100000:1.0:1788874005.577972:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 125 00000100:00100000:1.0:1788874005.577980:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14902:x1875769840226304:12345-192.168.202.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788874005.578121:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14902:x1875769840226304:12345-192.168.202.20@tcp:503:mount.lustre.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874005.578129:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 125 00000100:00100000:2.0:1788874005.581439:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.581527:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226432 00000100:00100000:3.0:1788874005.581537:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226432 00000100:00100000:3.0:1788874005.581597:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 126 00000100:00100000:3.0:1788874005.581607:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14924:x1875769840226432:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788874005.581765:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14924:x1875769840226432:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.581774:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 126 00000100:00100000:2.0:1788874005.585838:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.585937:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226560 00000100:00100000:0.0:1788874005.585947:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226560 00000100:00100000:0.0:1788874005.586003:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 127 00000100:00100000:0.0:1788874005.586014:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3476350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14924:x1875769840226560:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788874005.586292:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3476350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+10:14924:x1875769840226560:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 279us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.586301:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 127 00000100:00100000:2.0:1788874005.602637:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.602741:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226688 00000100:00100000:0.0:1788874005.602752:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226688 00000100:00100000:0.0:1788874005.602800:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:0.0:1788874005.602809:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875769840226688:12345-192.168.202.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788874005.602853:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb@192.168.202.20@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1788874005.602920:0:17157:0:(genops.c:1385:class_connect()) connect: client 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb, cookie 0x25c660afb0a9cc1f 00000004:00100000:0.0:1788874005.602945:0:17157:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788874005.603187:0:17157:0:(import.c:65:import_set_state_nolock()) ffff9d3450538000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788874005.603298:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2397:x1875769840226688:12345-192.168.202.20@tcp:38:mount.lustre.0 Request processed in 488us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.603306:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:2.0:1788874005.606303:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.606412:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226944 00000100:00100000:3.0:1788874005.606425:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226944 00000100:00100000:3.0:1788874005.606486:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:3.0:1788874005.606494:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875769840226944:12345-192.168.202.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788874005.606538:0:17156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb@192.168.202.20@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1788874005.606607:0:17156:0:(genops.c:1385:class_connect()) connect: client 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb, cookie 0x25c660afb0a9cc26 00000004:00100000:3.0:1788874005.606631:0:17156:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788874005.606845:0:17156:0:(import.c:65:import_set_state_nolock()) ffff9d3344250000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788874005.606916:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2397:x1875769840226944:12345-192.168.202.20@tcp:38:mount.lustre.0 Request processed in 421us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.606923:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:3.0:1788874005.608124:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874005.608224:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840226816 00000100:00100000:2.0:1788874005.608231:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840226816 00000100:00100000:2.0:1788874005.608339:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:2.0:1788874005.608349:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:0:x1875769840226816:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788874005.608381:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788874005.608452:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:0:x1875769840226816:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874005.608470:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00080000:0.0:1788874005.608682:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788874005.616489:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00010000:00010000:0.0:1788874005.616764:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874005.617287:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227200 00000100:00100000:3.0:1788874005.617299:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227200 00000100:00100000:3.0:1788874005.617382:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:3.0:1788874005.617394:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227200:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788874005.617429:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788874005.617516:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227200:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 124us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.617523:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:1.0:1788874005.620778:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874005.620864:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227072 00000100:00100000:3.0:1788874005.620874:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227072 00000100:00100000:3.0:1788874005.620946:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:3.0:1788874005.620955:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:0:x1875769840227072:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788874005.620997:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1788874005.621147:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788874005.621634:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:0:x1875769840227072:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 677us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.621642:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:1.0:1788874005.631461:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.632281:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227328 00000100:00100000:0.0:1788874005.632299:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227328 00000100:00100000:0.0:1788874005.632400:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:0.0:1788874005.632411:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227328:12345-192.168.202.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788874005.632564:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227328:12345-192.168.202.20@tcp:40:mount.lustre.0 Request processed in 154us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.632572:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:1.0:1788874005.637518:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874005.637558:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874005.637591:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874005.637650:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227712 00000100:00100000:0.0:1788874005.637662:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227712 00000100:00100000:2.0:1788874005.637671:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227456 00000100:00100000:2.0:1788874005.637675:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227456 00000100:00100000:2.0:1788874005.637710:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227584 00000100:00100000:2.0:1788874005.637713:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227584 00000100:00100000:0.0:1788874005.637717:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:2.0:1788874005.637728:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:0.0:1788874005.637729:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227712:12345-192.168.202.20@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788874005.637733:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875769840227456:12345-192.168.202.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788874005.637758:0:19195:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb@192.168.202.20@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788874005.637788:0:19195:0:(genops.c:1385:class_connect()) connect: client 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb, cookie 0x25c660afb0a9cc2d 00000100:00100000:0.0:1788874005.637806:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227712:12345-192.168.202.20@tcp:900:mount.lustre.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874005.637813:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00002000:00100000:2.0:1788874005.637814:0:19195:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb/ffff9d3341e87000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788874005.637842:0:19195:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788874005.638021:0:19195:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788874005.638028:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:3.0:1788874005.638034:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1875769840227584:12345-192.168.202.20@tcp:8:mount.lustre.0 00000100:00080000:2.0:1788874005.638059:0:19195:0:(import.c:65:import_set_state_nolock()) ffff9d3341e85000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1788874005.638062:0:19728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb@192.168.202.20@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1788874005.638083:0:19728:0:(genops.c:1385:class_connect()) connect: client 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb, cookie 0x25c660afb0a9cc34 00002000:00100000:3.0:1788874005.638088:0:19728:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb/ffff9d3344252800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788874005.638099:0:19728:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788874005.638102:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2397:x1875769840227456:12345-192.168.202.20@tcp:8:mount.lustre.0 Request processed in 369us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874005.638109:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00002000:00080000:3.0:1788874005.638231:0:19728:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788874005.638289:0:19728:0:(import.c:65:import_set_state_nolock()) ffff9d3344253800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788874005.638313:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2397:x1875769840227584:12345-192.168.202.20@tcp:8:mount.lustre.0 Request processed in 278us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.638320:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:1.0:1788874005.643669:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874005.644102:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227840 00000100:00100000:2.0:1788874005.644112:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227840 00000100:00100000:2.0:1788874005.644248:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:2.0:1788874005.644259:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227840:12345-192.168.202.20@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788874005.649126:0:17158:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4781us 00000004:00200000:3.0:1788874005.664126:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788874005.664247:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14902:x1875769840227840:12345-192.168.202.20@tcp:33:mount.lustre.0 Request processed in 19986us (20582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874005.664260:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:1.0:1788874005.875470:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874005.875620:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840227968 00000100:00100000:2.0:1788874005.875630:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840227968 00000100:00100000:2.0:1788874005.875688:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:2.0:1788874005.875699:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14947:x1875769840227968:12345-192.168.202.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788874005.875718:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874005.875756:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652600/0x25c660afb0a9cc3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9a34 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874005.875865:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cc42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874005.875879:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cc42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874005.875893:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cc42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788874005.875935:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788874005.875939:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788874005.875971:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cc42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874005.875996:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652600/0x25c660afb0a9cc3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a34 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874005.876015:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cc42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a34 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874005.876024:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:2.0:1788874005.876038:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788874005.876042:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653200, rc 0) 00000100:00100000:2.0:1788874005.876097:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:14947:x1875769840227968:12345-192.168.202.20@tcp:101:mkdir.0 Request processed in 400us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874005.876105:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:1.0:1788874006.254671:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788874006.254694:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859183488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788874006.254764:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.254854:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183488 00000100:00100000:1.0:1788874006.254862:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183488 00000100:00100000:1.0:1788874006.254915:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788874006.254923:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859183488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788874006.254945:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788874006.254964:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874006.254970:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788874006.254979:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859183616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788874006.254986:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859183488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.254992:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788874006.255003:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.255044:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859183488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788874006.255053:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183616 00000100:00100000:3.0:1788874006.255056:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183616 00000100:00100000:3.0:1788874006.255077:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788874006.255096:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859183616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788874006.255106:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788874006.255137:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859183616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00080000:0.0:1788874006.256624:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788874006.256692:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859183616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788874006.258395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788874006.258428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859183744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788874006.258511:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874006.258564:0:18664:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788874006.258573:0:18664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788874006.258685:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183744 00000100:00100000:2.0:1788874006.258692:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183744 00000100:00100000:2.0:1788874006.258834:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788874006.258844:0:19948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859183744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788874006.258877:0:19948:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788874006.258921:0:19948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875769859183744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874006.258928:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788874006.258970:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859183744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788874006.259648:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788874006.259680:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788874006.260101:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859183872:0@lo:400:kworker.0 00000100:00100000:2.0:1788874006.260243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.260313:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859183872 00000100:00100000:1.0:1788874006.260319:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859183872 00000100:00100000:1.0:1788874006.260362:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788874006.260370:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:3636:x1875769859183872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.260474:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859184000:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.260652:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.260659:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:3636:x1875769859183872:12345-0@lo:400:kworker.0 Request processed in 287us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.260678:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788874006.260683:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788874006.260692:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859184128:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.260724:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.260747:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859184256:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.260759:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184000 00000100:00100000:3.0:1788874006.260764:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184000 00000100:00100000:1.0:1788874006.260780:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874006.260795:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184256 00000100:00100000:3.0:1788874006.260799:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184256 00000100:00100000:3.0:1788874006.260833:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788874006.260837:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184128 00000100:00100000:3.0:1788874006.260842:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859184000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.260843:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184128 00000100:00100000:3.0:1788874006.260884:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859184000:12345-0@lo:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874006.260891:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788874006.260904:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788874006.260910:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859184256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.260940:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859184256:12345-0@lo:400:kworker.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874006.260946:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788874006.260977:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859184000:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.261011:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859184256:0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.261017:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788874006.261099:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859184128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.261236:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875769859184128:12345-0@lo:400:kworker.0 Request processed in 210us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.261242:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788874006.261393:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859183872:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.261479:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d33441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875769859184128:0@lo:400:kworker.0 00000100:00100000:2.0:1788874006.261793:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859184384:0@lo:400:kworker.0 00000100:00100000:2.0:1788874006.261837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.261976:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184384 00000100:00100000:1.0:1788874006.261981:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184384 00000100:00100000:1.0:1788874006.262047:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788874006.262055:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859184384:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788874006.262172:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874006.262197:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859184512:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.262242:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874006.262331:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788874006.262339:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859184640:0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.262347:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859184384:12345-0@lo:400:kworker.0 Request processed in 289us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.262356:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788874006.262371:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.262391:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184512 00000100:00100000:1.0:1788874006.262396:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184512 00000100:00100000:1.0:1788874006.262421:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184640 00000100:00100000:1.0:1788874006.262431:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184640 00000100:00100000:1.0:1788874006.262459:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788874006.262466:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859184512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.262478:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859184768:0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.262527:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875769859184512:12345-0@lo:400:kworker.0 Request processed in 61us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.262534:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788874006.262545:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788874006.262551:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859184640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.262588:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875769859184640:12345-0@lo:400:kworker.0 Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.262594:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788874006.262611:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788874006.262654:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874006.262700:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1875769859184640:0@lo:400:kworker.0 00000100:00100000:3.0:1788874006.262711:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875769859184512:0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.262882:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184768 00000100:00100000:1.0:1788874006.262886:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184768 00000100:00100000:1.0:1788874006.262926:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788874006.262933:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859184768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.262971:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859184768:12345-0@lo:400:kworker.0 Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.262977:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788874006.263005:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343afc700 x1875769859184768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874006.263015:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859184768:0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.263414:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788874006.263424:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859185024:0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.263456:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788874006.263577:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788874006.263607:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185024 00000100:00100000:0.0:1788874006.263621:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185024 00000100:00080000:3.0:1788874006.263658:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788874006.263672:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788874006.263681:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859185024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874006.263912:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859184384:0@lo:400:kworker.0 00000100:00100000:2.0:1788874006.263933:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859184896:0@lo:400:kworker.0 00000100:00100000:0.0:1788874006.264050:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859185024:12345-0@lo:400:kworker.0 Request processed in 370us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874006.264058:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788874006.264253:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343afd500 x1875769859185024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874006.264274:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859185024:0@lo:400:kworker.0 00000100:00100000:2.0:1788874006.264380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874006.264470:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859184896 00000100:00100000:1.0:1788874006.264594:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859184896 00000100:00080000:3.0:1788874006.264666:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788874006.264832:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788874006.264842:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859184896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874006.264914:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875769859184896:12345-0@lo:400:kworker.0 Request processed in 73us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874006.264921:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788874006.264989:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1875769859184896:0@lo:400:kworker.0 00010000:00010000:0.0:1788874006.638877:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788874006.771723:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb 00000001:00080000:2.0:1788874006.771739:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:3.0:1788874007.087599:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788874007.662626:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874007.790110:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874007.790288:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228096 00000100:00100000:0.0:1788874007.790298:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228096 00000100:00100000:0.0:1788874007.790373:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:0.0:1788874007.790383:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:14999:x1875769840228096:12345-192.168.202.20@tcp:41:lfs.0 00000004:00000024:0.0:1788874007.790420:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788874007.790500:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:14999:x1875769840228096:12345-192.168.202.20@tcp:41:lfs.0 Request processed in 117us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874007.790507:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:0.0:1788874007.790863:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859185152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788874007.790907:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874007.791069:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185152 00000100:00100000:2.0:1788874007.791075:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185152 00000100:00100000:2.0:1788874007.791128:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788874007.791136:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859185152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788874007.791157:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788874007.791237:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859185152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874007.791245:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788874007.791349:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859185152:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788874007.791695:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788874007.797644:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874007.797681:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228224 00000100:00100000:0.0:1788874007.797690:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228224 00000100:00100000:0.0:1788874007.797749:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:0.0:1788874007.797759:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14999:x1875769840228224:12345-192.168.202.20@tcp:41:lfs.0 00000004:00000024:0.0:1788874007.797797:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788874007.797890:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:14999:x1875769840228224:12345-192.168.202.20@tcp:41:lfs.0 Request processed in 132us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874007.797911:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00080000:0.0:1788874007.797936:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788874007.799235:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb 00000100:00100000:3.0:1788874007.801914:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874007.801988:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228352 00000100:00100000:0.0:1788874007.801998:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228352 00000100:00100000:0.0:1788874007.802434:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:0.0:1788874007.802447:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:14999:x1875769840228352:12345-192.168.202.20@tcp:13:lfs.0 00002000:00000024:0.0:1788874007.802494:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788874007.802576:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:14999:x1875769840228352:12345-192.168.202.20@tcp:13:lfs.0 Request processed in 132us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874007.802584:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00080000:2.0:1788874007.805350:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874007.812041:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874007.812126:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228480 00000100:00100000:0.0:1788874007.812136:0:19948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228480 00000100:00100000:0.0:1788874007.812231:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:0.0:1788874007.812242:0:19948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:14999:x1875769840228480:12345-192.168.202.20@tcp:13:lfs.0 00002000:00000024:0.0:1788874007.812280:0:19948:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788874007.812370:0:19948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:14999:x1875769840228480:12345-192.168.202.20@tcp:13:lfs.0 Request processed in 130us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874007.812379:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00080000:2.0:1788874007.812817:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788874008.001532:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.001744:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228608 00000100:00100000:2.0:1788874008.001755:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228608 00000100:00100000:2.0:1788874008.001824:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 129 00000100:00100000:2.0:1788874008.001857:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+10:15029:x1875769840228608:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788874008.001873:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874008.001892:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441652600/0x25c660afb0a9cc49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9a3b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.001925:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441652600/0x25c660afb0a9cc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a3b expref: 11 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.001938:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441652600/0x25c660afb0a9cc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a3b expref: 11 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.001948:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652600, rc 0) 00000100:00100000:2.0:1788874008.002021:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15029:x1875769840228608:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 188us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.002029:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 129 00000100:00100000:1.0:1788874008.022966:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874008.023097:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228736 00000100:00100000:3.0:1788874008.023107:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228736 00000100:00100000:3.0:1788874008.023584:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 130 00000100:00100000:3.0:1788874008.023598:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15029:x1875769840228736:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788874008.023997:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15029:x1875769840228736:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 402us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.024005:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 130 00000100:00100000:1.0:1788874008.035808:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874008.035972:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228864 00000100:00100000:3.0:1788874008.035999:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228864 00000100:00100000:3.0:1788874008.036067:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 131 00000100:00100000:3.0:1788874008.036077:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15029:x1875769840228864:12345-192.168.202.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788874008.036257:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15029:x1875769840228864:12345-192.168.202.20@tcp:503:mount.lustre.0 Request processed in 180us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.036266:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 131 00000100:00100000:0.0:1788874008.053779:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874008.054145:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840228992 00000100:00100000:3.0:1788874008.054154:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840228992 00000100:00100000:3.0:1788874008.054241:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 132 00000100:00100000:3.0:1788874008.054252:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15037:x1875769840228992:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788874008.054408:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15037:x1875769840228992:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 157us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.054415:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 132 00000100:00100000:1.0:1788874008.116609:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.116702:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229120 00000100:00100000:2.0:1788874008.116739:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229120 00000100:00100000:2.0:1788874008.116807:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 133 00000100:00100000:2.0:1788874008.116818:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15037:x1875769840229120:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788874008.116979:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15037:x1875769840229120:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 162us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.116986:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 133 00000100:00100000:1.0:1788874008.125007:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874008.125093:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229248 00000100:00100000:0.0:1788874008.125103:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229248 00000100:00100000:0.0:1788874008.125195:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 134 00000100:00100000:0.0:1788874008.125227:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15037:x1875769840229248:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788874008.125520:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15037:x1875769840229248:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 315us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.125531:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 134 00000100:00100000:0.0:1788874008.131165:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.131404:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229376 00000100:00100000:2.0:1788874008.131415:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229376 00000100:00100000:2.0:1788874008.131743:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 135 00000100:00100000:2.0:1788874008.131755:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+11:15029:x1875769840229376:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788874008.131772:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874008.131790:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441652e00/0x25c660afb0a9cc50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9a6c expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.131829:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441652e00/0x25c660afb0a9cc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a6c expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.131838:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441652e00/0x25c660afb0a9cc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a6c expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.131847:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652e00, rc 0) 00000100:00100000:2.0:1788874008.131907:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+12:15029:x1875769840229376:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 155us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.131912:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 135 00000100:00100000:1.0:1788874008.136680:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874008.136844:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229504 00000100:00100000:0.0:1788874008.136854:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229504 00000100:00100000:0.0:1788874008.136910:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 136 00000100:00100000:0.0:1788874008.136920:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+12:15029:x1875769840229504:12345-192.168.202.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788874008.136945:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788874008.136971:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788874008.136975:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788874008.136978:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788874008.136980:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788874008.136983:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788874008.144913:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+12:15029:x1875769840229504:12345-192.168.202.20@tcp:256:mount.lustre.0 Request processed in 7984us (8233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.144929:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 136 00000100:00100000:1.0:1788874008.157662:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.157858:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229632 00000100:00100000:2.0:1788874008.157870:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229632 00000100:00100000:2.0:1788874008.157934:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 137 00000100:00100000:2.0:1788874008.157944:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+12:15029:x1875769840229632:12345-192.168.202.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788874008.157974:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874008.157993:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9a73 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.158021:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.158031:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.158040:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652a00, rc 0) 00000100:00100000:2.0:1788874008.158100:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15029:x1875769840229632:12345-192.168.202.20@tcp:101:mount.lustre.0 Request processed in 157us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.158108:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 137 00000100:00100000:1.0:1788874008.160615:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874008.160892:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229760 00000100:00100000:0.0:1788874008.160902:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229760 00000100:00100000:0.0:1788874008.160957:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:0.0:1788874008.160966:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15029:x1875769840229760:12345-192.168.202.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788874008.161115:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15029:x1875769840229760:12345-192.168.202.20@tcp:501:mount.lustre.0 Request processed in 149us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.161123:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 138 00000100:00100000:1.0:1788874008.167751:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874008.167891:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840229888 00000100:00100000:3.0:1788874008.167901:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840229888 00000100:00100000:3.0:1788874008.167954:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 139 00000100:00100000:3.0:1788874008.167964:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15029:x1875769840229888:12345-192.168.202.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788874008.168103:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15029:x1875769840229888:12345-192.168.202.20@tcp:503:mount.lustre.0 Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.168111:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 139 00000100:00100000:1.0:1788874008.176048:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.178142:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230016 00000100:00100000:2.0:1788874008.178157:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230016 00000100:00100000:2.0:1788874008.178239:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 140 00000100:00100000:2.0:1788874008.178251:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15043:x1875769840230016:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788874008.178967:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15043:x1875769840230016:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 716us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.178977:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 140 00000100:00100000:1.0:1788874008.185614:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874008.185881:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230144 00000100:00100000:0.0:1788874008.185891:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230144 00000100:00100000:0.0:1788874008.185946:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 141 00000100:00100000:0.0:1788874008.185957:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15043:x1875769840230144:12345-192.168.202.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788874008.186109:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:15043:x1875769840230144:12345-192.168.202.20@tcp:502:llog_process_th.0 Request processed in 152us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.186117:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 141 00000100:00100000:1.0:1788874008.196526:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.196566:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.196591:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.196676:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.196695:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.196754:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230912 00000100:00100000:2.0:1788874008.196765:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230912 00000100:00100000:2.0:1788874008.196831:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:2.0:1788874008.196841:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2398:x1875769840230912:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788874008.196905:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2398:x1875769840230912:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.196923:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:1.0:1788874008.200706:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.202467:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230784 00000100:00100000:1.0:1788874008.202550:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230784 00000100:00100000:1.0:1788874008.202616:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:1.0:1788874008.202627:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2398:x1875769840230784:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788874008.202697:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2398:x1875769840230784:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 72us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874008.202704:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:3.0:1788874008.203413:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230272 00000100:00100000:3.0:1788874008.203420:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230272 00000100:00100000:3.0:1788874008.203444:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231040 00000100:00100000:3.0:1788874008.203448:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231040 00000100:00100000:3.0:1788874008.203455:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230656 00000100:00100000:3.0:1788874008.203457:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230656 00000100:00100000:0.0:1788874008.203960:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230528 00000100:00100000:0.0:1788874008.203967:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230528 00000100:00100000:0.0:1788874008.203996:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:0.0:1788874008.204005:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2398:x1875769840230656:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874008.204071:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2398:x1875769840230656:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 67us (7478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.204078:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:0.0:1788874008.204093:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788874008.204100:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2398:x1875769840230528:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874008.204126:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2398:x1875769840230528:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 27us (7429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.204131:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788874008.204145:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:0.0:1788874008.204149:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875769840230272:12345-192.168.202.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788874008.204198:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6ca012d0-0acd-4ca6-971d-710455c35699@192.168.202.20@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1788874008.204250:0:17155:0:(genops.c:1385:class_connect()) connect: client 6ca012d0-0acd-4ca6-971d-710455c35699, cookie 0x25c660afb0a9cc5e 00000004:00100000:0.0:1788874008.204276:0:17155:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788874008.204394:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9d3341fee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788874008.204426:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ca012d0-0acd-4ca6-971d-710455c35699+6:2397:x1875769840230272:12345-192.168.202.20@tcp:38:mount.lustre.0 Request processed in 274us (7910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.204432:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:0.0:1788874008.204462:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:0.0:1788874008.204467:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875769840231040:12345-192.168.202.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788874008.204483:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6ca012d0-0acd-4ca6-971d-710455c35699@192.168.202.20@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1788874008.204509:0:17155:0:(genops.c:1385:class_connect()) connect: client 6ca012d0-0acd-4ca6-971d-710455c35699, cookie 0x25c660afb0a9cc65 00000004:00100000:0.0:1788874008.204522:0:17155:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788874008.204563:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9d3341fea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788874008.204580:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ca012d0-0acd-4ca6-971d-710455c35699+6:2397:x1875769840231040:12345-192.168.202.20@tcp:38:mount.lustre.0 Request processed in 112us (8015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.204584:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:1.0:1788874008.210520:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.210560:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.210596:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874008.210673:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231168 00000100:00100000:3.0:1788874008.210698:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231168 00000100:00100000:3.0:1788874008.210763:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231296 00000100:00100000:3.0:1788874008.210766:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231296 00000100:00100000:3.0:1788874008.210779:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840230400 00000100:00100000:3.0:1788874008.210781:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840230400 00000100:00100000:3.0:1788874008.210807:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:3.0:1788874008.210817:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:0:x1875769840231168:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788874008.210858:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788874008.210916:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:0:x1875769840231168:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 100us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.210923:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:3.0:1788874008.210941:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:3.0:1788874008.210948:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+7:15029:x1875769840231296:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788874008.210964:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788874008.210989:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+7:15029:x1875769840231296:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 42us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.210995:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:3.0:1788874008.211006:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:3.0:1788874008.211012:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:0:x1875769840230400:12345-192.168.202.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788874008.211036:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788874008.211059:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:0:x1875769840230400:12345-192.168.202.20@tcp:41:mount.lustre.0 Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.211065:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00080000:1.0:1788874008.211168:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788874008.211172:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788874008.213564:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874008.213627:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231424 00000100:00100000:3.0:1788874008.213636:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231424 00000100:00100000:3.0:1788874008.213690:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:3.0:1788874008.213911:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:15029:x1875769840231424:12345-192.168.202.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788874008.213997:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:15029:x1875769840231424:12345-192.168.202.20@tcp:40:mount.lustre.0 Request processed in 91us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.214004:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:1.0:1788874008.217152:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.217329:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874008.217359:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874008.217402:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231808 00000100:00100000:0.0:1788874008.217413:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231808 00000100:00100000:0.0:1788874008.217486:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:0.0:1788874008.217496:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6ca012d0-0acd-4ca6-971d-710455c35699+6:15029:x1875769840231808:12345-192.168.202.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788874008.217577:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6ca012d0-0acd-4ca6-971d-710455c35699+6:15029:x1875769840231808:12345-192.168.202.20@tcp:900:mount.lustre.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.217584:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:2.0:1788874008.217747:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231552 00000100:00100000:2.0:1788874008.217752:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231552 00000100:00100000:2.0:1788874008.218774:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231680 00000100:00100000:2.0:1788874008.218781:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231680 00000100:00100000:0.0:1788874008.226697:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:0.0:1788874008.226710:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875769840231552:12345-192.168.202.20@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788874008.226745:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00010000:00080000:0.0:1788874008.226751:0:18663:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6ca012d0-0acd-4ca6-971d-710455c35699@192.168.202.20@tcp t0 exp 0000000000000000 cur 545 last 0 00000100:00100000:2.0:1788874008.226756:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875769840231680:12345-192.168.202.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788874008.226781:0:19195:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6ca012d0-0acd-4ca6-971d-710455c35699@192.168.202.20@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1788874008.226805:0:18663:0:(genops.c:1385:class_connect()) connect: client 6ca012d0-0acd-4ca6-971d-710455c35699, cookie 0x25c660afb0a9cc6c 00000020:00000080:2.0:1788874008.226817:0:19195:0:(genops.c:1385:class_connect()) connect: client 6ca012d0-0acd-4ca6-971d-710455c35699, cookie 0x25c660afb0a9cc73 00002000:00100000:0.0:1788874008.226820:0:18663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6ca012d0-0acd-4ca6-971d-710455c35699/ffff9d3341fee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788874008.226827:0:19195:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6ca012d0-0acd-4ca6-971d-710455c35699/ffff9d347a768000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788874008.226833:0:18663:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788874008.226837:0:19195:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788874008.226932:0:19195:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1788874008.226933:0:18663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788874008.226980:0:19195:0:(import.c:65:import_set_state_nolock()) ffff9d347a76d000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788874008.227421:0:18663:0:(import.c:65:import_set_state_nolock()) ffff9d3341fe9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788874008.227479:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6ca012d0-0acd-4ca6-971d-710455c35699+6:2397:x1875769840231552:12345-192.168.202.20@tcp:8:mount.lustre.0 Request processed in 769us (10336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.227487:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:2.0:1788874008.227691:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6ca012d0-0acd-4ca6-971d-710455c35699+6:2397:x1875769840231680:12345-192.168.202.20@tcp:8:mount.lustre.0 Request processed in 936us (10329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.227700:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:1.0:1788874008.227987:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874008.228729:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840231936 00000100:00100000:0.0:1788874008.228737:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840231936 00000100:00100000:0.0:1788874008.228783:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:0.0:1788874008.228874:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:15029:x1875769840231936:12345-192.168.202.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788874008.228961:0:17159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788874008.229027:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ca012d0-0acd-4ca6-971d-710455c35699+6:15029:x1875769840231936:12345-192.168.202.20@tcp:33:mount.lustre.0 Request processed in 236us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874008.229034:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:3.0:1788874008.390740:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874008.391254:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232064 00000100:00100000:2.0:1788874008.391269:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232064 00000100:00100000:2.0:1788874008.391491:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:2.0:1788874008.391505:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+6:15067:x1875769840232064:12345-192.168.202.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788874008.391530:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874008.391558:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653a00/0x25c660afb0a9cc7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9aa4 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.391646:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.391679:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.391697:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788874008.391753:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788874008.391757:0:17157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788874008.391781:0:17157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.391909:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653a00/0x25c660afb0a9cc7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.391938:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 7 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874008.391949:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:2.0:1788874008.391953:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788874008.391959:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652800, rc 0) 00000100:00100000:2.0:1788874008.392045:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+7:15067:x1875769840232064:12345-192.168.202.20@tcp:101:mkdir.0 Request processed in 543us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874008.392053:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00010000:00010000:0.0:1788874008.690071:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874008.814477:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d34412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859185280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788874008.814553:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874008.814663:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185280 00000100:00100000:3.0:1788874008.814671:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185280 00000100:00100000:3.0:1788874008.814723:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788874008.814733:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859185280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788874008.814758:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788874008.815038:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859185408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788874008.815078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874008.815124:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788874008.815133:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788874008.815272:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185408 00000100:00100000:1.0:1788874008.815276:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185408 00000100:00100000:1.0:1788874008.815383:0:19949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788874008.815391:0:19949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859185408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788874008.815405:0:19949:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788874008.815442:0:19949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859185408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874008.815456:0:19949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788874008.815500:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859185408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788874008.815870:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859185280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1137us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874008.815878:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788874008.815947:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d34412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859185280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788874009.710738:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788874009.903999:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788874010.726796:0:20035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788874010.736511:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788874010.868816:0:17888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6ca012d0-0acd-4ca6-971d-710455c35699 00000001:00100000:2.0:1788874010.868839:0:17888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb 00000001:00100000:2.0:1788874010.872921:0:17135:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6ca012d0-0acd-4ca6-971d-710455c35699 00000001:00100000:2.0:1788874010.872933:0:17135:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb 00000100:00100000:2.0:1788874011.374913:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859185664:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.374996:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375053:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859186176:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.375077:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375092:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859186688:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.375116:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375133:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859187200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788874011.375155:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375177:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788874011.375182:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859185536:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.375228:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375249:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859186048:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.375269:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375283:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859186560:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.375299:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.375313:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859187072:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.375410:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185664 00000100:00100000:3.0:1788874011.375426:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185664 00000100:00100000:3.0:1788874011.375466:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186176 00000100:00100000:3.0:1788874011.375469:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186176 00000100:00100000:3.0:1788874011.375485:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788874011.375494:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859185664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.375563:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859185664:12345-0@lo:400:kworker.0 Request processed in 69us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.375571:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788874011.375586:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788874011.375592:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859186176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.375621:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859186176:12345-0@lo:400:kworker.0 Request processed in 29us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.375636:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788874011.375657:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186688 00000100:00100000:3.0:1788874011.375661:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186688 00000100:00100000:3.0:1788874011.375687:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186048 00000100:00100000:3.0:1788874011.375690:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186048 00000100:00100000:3.0:1788874011.375700:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186560 00000100:00100000:3.0:1788874011.375703:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186560 00000100:00100000:3.0:1788874011.375715:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788874011.375721:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859186688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.375751:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859186688:12345-0@lo:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.375758:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788874011.375782:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788874011.375788:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859186048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.375817:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859186048:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.375822:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788874011.375833:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788874011.375839:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859186560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.375864:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859186560:12345-0@lo:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.375870:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788874011.375890:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187200 00000100:00100000:3.0:1788874011.375895:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187200 00000100:00100000:3.0:1788874011.375922:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874011.375932:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859187200:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788874011.375932:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859185792:0@lo:400:kworker.0 00002000:00000024:3.0:1788874011.375969:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788874011.375975:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874011.376004:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859186304:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.376017:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859187200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.376024:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788874011.376033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874011.376071:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185536 00000100:00100000:1.0:1788874011.376074:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859186816:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.376077:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185536 00000100:00100000:1.0:1788874011.376106:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874011.376113:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788874011.376122:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:3634:x1875769859185536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376137:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788874011.376147:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859185920:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.376157:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:3634:x1875769859185536:12345-0@lo:400:kworker.0 Request processed in 37us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.376165:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788874011.376176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874011.376195:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185792 00000100:00100000:3.0:1788874011.376199:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185792 00000100:00100000:1.0:1788874011.376220:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859186432:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.376235:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186304 00000100:00100000:3.0:1788874011.376238:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186304 00000100:00100000:1.0:1788874011.376249:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874011.376256:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859185920 00000100:00100000:3.0:1788874011.376259:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859185920 00000100:00100000:1.0:1788874011.376268:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859186944:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.376269:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186432 00000100:00100000:3.0:1788874011.376274:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186432 00000100:00100000:3.0:1788874011.376294:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788874011.376304:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859185792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376305:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788874011.376337:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788874011.376342:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788874011.376344:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788874011.376384:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788874011.376392:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859186304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376423:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859186304:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874011.376430:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788874011.376451:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874011.376457:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859185920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376486:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859185920:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874011.376492:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874011.376503:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788874011.376508:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859186432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376534:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859186432:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874011.376540:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788874011.376555:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788874011.376568:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859187328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788874011.376592:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874011.376619:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187328 00000100:00100000:1.0:1788874011.376624:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187328 00000100:00100000:1.0:1788874011.376653:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788874011.376662:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859187328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788874011.376677:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186816 00002000:00000024:1.0:1788874011.376680:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788874011.376683:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186816 00000100:00100000:1.0:1788874011.376714:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875769859187328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874011.376716:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859186944 00000100:00100000:0.0:1788874011.376721:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859186944 00000100:00100000:1.0:1788874011.376726:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788874011.376744:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788874011.376753:0:17156:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788874011.376754:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859186816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376773:0:17156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788874011.376809:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859186816:12345-0@lo:400:kworker.0 Request processed in 58us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874011.376817:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788874011.376835:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788874011.376842:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859186944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874011.376871:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859186944:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874011.376889:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788874011.376895:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00080000:0.0:1788874011.376915:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788874011.376917:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859185920:0@lo:400:kworker.0 00000100:00080000:0.0:1788874011.376919:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788874011.376934:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859187456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788874011.376937:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859186432:0@lo:400:kworker.0 00000100:00100000:1.0:1788874011.376964:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859186944:0@lo:400:kworker.0 00000100:00100000:0.0:1788874011.376965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874011.376984:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859186304:0@lo:400:kworker.0 00010000:00080000:1.0:1788874011.377004:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343afd500 x1875769859186816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874011.377008:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1875769859187328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788874011.377022:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859186816:0@lo:400:kworker.0 00000100:00100000:0.0:1788874011.377043:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187456 00000100:00100000:0.0:1788874011.377047:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187456 00000100:00100000:0.0:1788874011.377071:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788874011.377079:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859187456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788874011.377090:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788874011.377122:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859187456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874011.377128:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788874011.377155:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859187456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788874011.377406:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874011.377625:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859185664:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.377637:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859186176:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.377648:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859186688:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.377672:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859187200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788874011.377693:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859185536:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.377703:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859186048:0@lo:400:kworker.0 00000100:00100000:2.0:1788874011.377712:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859186560:0@lo:400:kworker.0 00000100:00100000:3.0:1788874011.377968:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859185792:12345-0@lo:400:kworker.0 Request processed in 1666us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874011.377977:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874011.378049:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187072 00000100:00100000:0.0:1788874011.378053:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187072 00000100:00100000:0.0:1788874011.378100:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788874011.378107:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859187072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874011.378151:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859187072:12345-0@lo:400:kworker.0 Request processed in 44us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874011.378158:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788874011.378195:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859185792:0@lo:400:kworker.0 00000100:00080000:2.0:1788874011.378673:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788874011.378697:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3343afc700 x1875769859187072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874011.378707:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859187072:0@lo:400:kworker.0 00010000:00010000:0.0:1788874011.762348:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874012.783598:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874012.914187:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788874012.914323:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859187584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788874012.914425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874012.923862:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187584 00000100:00100000:3.0:1788874012.923881:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187584 00000100:00100000:2.0:1788874012.926415:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788874012.926444:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859187584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788874012.926479:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788874012.926591:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859187584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (12167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874012.926598:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788874012.926671:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859187584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788874013.340728:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340787:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340813:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340830:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340854:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340866:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340876:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340886:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340904:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874013.340928:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232576 00000100:00100000:1.0:1788874013.340938:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232576 00000100:00100000:1.0:1788874013.340996:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233088 00000100:00100000:1.0:1788874013.340998:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233088 00000100:00100000:1.0:1788874013.341007:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232704 00000100:00100000:1.0:1788874013.341009:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232704 00000100:00100000:1.0:1788874013.341018:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233216 00000100:00100000:1.0:1788874013.341019:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233216 00000100:00100000:1.0:1788874013.341034:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788874013.341043:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2400:x1875769840232576:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788874013.341120:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2400:x1875769840232576:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 78us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874013.341143:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788874013.341158:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:1.0:1788874013.341162:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840233088:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788874013.341179:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840233088:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 17us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874013.341183:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:1.0:1788874013.341189:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:1.0:1788874013.341193:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2400:x1875769840232704:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788874013.341236:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2400:x1875769840232704:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 43us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874013.341240:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:1.0:1788874013.341248:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00100000:1.0:1788874013.341252:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840233216:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788874013.341265:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840233216:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 13us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874013.341269:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 12 00000100:00080000:1.0:1788874013.341280:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788874013.341284:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788874013.341449:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232320 00000100:00100000:0.0:1788874013.341454:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232320 00000100:00100000:0.0:1788874013.341485:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232832 00000100:00100000:0.0:1788874013.341493:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232832 00000100:00100000:0.0:1788874013.341506:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232448 00000100:00100000:0.0:1788874013.341507:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232448 00000100:00100000:0.0:1788874013.341516:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232960 00000100:00100000:0.0:1788874013.341518:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232960 00000100:00100000:0.0:1788874013.341528:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:0.0:1788874013.341532:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2400:x1875769840232320:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874013.341562:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2400:x1875769840232320:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874013.341567:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:0.0:1788874013.341577:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:0.0:1788874013.341581:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840232832:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874013.341594:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840232832:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 13us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874013.341598:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:0.0:1788874013.341603:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:0.0:1788874013.341607:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2400:x1875769840232448:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874013.341620:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2400:x1875769840232448:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 13us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874013.341624:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:0.0:1788874013.341630:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:0.0:1788874013.341633:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+5:2400:x1875769840232960:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874013.341646:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+5:2400:x1875769840232960:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 12us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874013.341650:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:0.0:1788874013.341669:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840232192 00000100:00100000:0.0:1788874013.341671:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840232192 00000100:00100000:0.0:1788874013.341689:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 143 00000100:00100000:0.0:1788874013.341693:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:2400:x1875769840232192:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874013.341710:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:2400:x1875769840232192:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 18us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874013.341715:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 143 00000100:00080000:1.0:1788874013.342131:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788874013.342134:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788874013.806517:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874013.935886:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788874013.935920:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859187712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788874013.936024:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874013.936225:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187712 00000100:00100000:3.0:1788874013.937130:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187712 00000100:00100000:3.0:1788874013.937226:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788874013.938137:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859187712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788874013.938193:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788874013.938828:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859187712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1589us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874013.938840:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788874013.938900:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859187840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788874013.938948:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874013.939005:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859187840 00000100:00100000:3.0:1788874013.939024:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859187840 00000100:00100000:3.0:1788874013.940181:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788874013.940197:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859187840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788874013.940260:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788874013.940339:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859187840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874013.940346:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788874013.940413:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859187840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788874013.940805:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859187712:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788874013.941403:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6ca012d0-0acd-4ca6-971d-710455c35699 00000001:00100000:3.0:1788874013.945324:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6ca012d0-0acd-4ca6-971d-710455c35699 00000020:00000080:2.0:1788874014.104353:0:20183:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2926d410 20000000:00000080:2.0:1788874014.104376:0:20183:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d347505b400 uarg=0000000000000000 20000000:01000000:2.0:1788874014.104501:0:20183:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788874014.104517:0:20183:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788874014.104523:0:20183:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788874014.105157:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788874014.105332:0:20183:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788874014.111873:0:20183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788874014.111916:0:20183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.111938:0:20183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.111970:0:20183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.111978:0:20183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.111985:0:20183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.111999:0:20183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112007:0:20183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112016:0:20183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112381:0:20183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112401:0:20183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 12 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.112430:0:20183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859187968:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788874014.112573:0:20183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112583:0:20183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 12 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.112599:0:20183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188096:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788874014.112635:0:20183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112644:0:20183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 23 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.112657:0:20183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188224:0@lo:104: 00000100:00100000:3.0:1788874014.112726:0:20183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788874014.112788:0:20183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112797:0:20183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 23 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.112805:0:20183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188352:0@lo:104: 00000100:00100000:3.0:1788874014.112827:0:20183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788874014.112852:0:20183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112860:0:20183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 23 pid: 17149 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.112869:0:20183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188480:0@lo:104: 00000100:00100000:3.0:1788874014.112890:0:20183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788874014.112908:0:20183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.112928:0:20183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 23 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.112936:0:20183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188608:0@lo:104: 00000100:00100000:3.0:1788874014.112960:0:20183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874014.112973:0:20183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3343867a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874014.114082:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188224 00000100:00100000:1.0:1788874014.114103:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188224 00000100:00100000:1.0:1788874014.114156:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188352 00000100:00100000:1.0:1788874014.114159:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188352 00000100:00100000:1.0:1788874014.114170:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188480 00000100:00100000:1.0:1788874014.114173:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188480 00000100:00100000:1.0:1788874014.114181:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188608 00000100:00100000:1.0:1788874014.114183:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188608 00000100:00100000:1.0:1788874014.114199:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788874014.114235:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+6:20183:x1875769859188224:12345-0@lo:104: 00010000:00010000:1.0:1788874014.114256:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114352:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788874014.114360:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+6:20183:x1875769859188224:12345-0@lo:104: Request processed in 128us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874014.114368:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788874014.114387:0:20183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188224:0@lo:104: 00000100:00100000:1.0:1788874014.114387:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788874014.114394:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+5:20183:x1875769859188352:12345-0@lo:104: 00010000:00010000:1.0:1788874014.114402:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114448:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788874014.114453:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+5:20183:x1875769859188352:12345-0@lo:104: Request processed in 60us (1625us total) trans 0 rc 0/0 00010000:00010000:0.0:1788874014.114454:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788874014.114459:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788874014.114462:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874014.114470:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33442b2000 already unused, calling callback (ffffffffc145cc20) 00000100:00100000:1.0:1788874014.114472:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 10000000:00010000:0.0:1788874014.114475:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874014.114478:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+4:20183:x1875769859188480:12345-0@lo:104: 00010000:00010000:0.0:1788874014.114485:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114486:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874014.114495:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874014.114503:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788874014.114533:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788874014.114537:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+4:20183:x1875769859188480:12345-0@lo:104: Request processed in 61us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874014.114543:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788874014.114549:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874014.114555:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788874014.114556:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788874014.114560:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+3:20183:x1875769859188608:12345-0@lo:104: 00010000:00010000:1.0:1788874014.114567:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874014.114582:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114591:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1788874014.114591:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d33442b2000/0x25c660afb0a9c9fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9ca04 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874014.114595:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a50e61a-7558-480a-b914-36a6e76b41da+3:20183:x1875769859188608:12345-0@lo:104: Request processed in 36us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874014.114601:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788874014.114614:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788874014.114616:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788874014.114618:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114621:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874014.114624:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb800 already unused, calling callback (ffffffffc145cc20) 00010000:00010000:1.0:1788874014.114628:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:0.0:1788874014.114628:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788874014.114631:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874014.114635:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114637:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874014.114642:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788874014.114644:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874014.114648:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788874014.114650:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788874014.114662:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114668:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114674:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788874014.114692:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114699:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d347f443600/0x25c660afb0a9c924 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c92b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114710:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874014.114713:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114719:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3343ad8800 already unused, calling callback (ffffffffc145cc20) 10000000:00010000:1.0:1788874014.114723:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114730:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788874014.114736:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874014.114754:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788874014.114757:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874014.114767:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114773:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788874014.114780:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874014.114786:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874014.114792:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114798:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3343ad8800/0x25c660afb0a9c916 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c91d expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874014.114800:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.120@tcp lock: ffff9d3475ecb800/0x25c660afb0a9c963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c660afb0a9c96a expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.114808:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874014.114810:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874014.114811:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874014.114814:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874014.114815:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874014.114817:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874014.114827:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859188992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788874014.114834:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859188736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788874014.114866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874014.114868:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859189120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788874014.114943:0:20183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188352:0@lo:104: 00000100:00100000:3.0:1788874014.114952:0:20183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188480:0@lo:104: 00000100:00100000:3.0:1788874014.114959:0:20183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188608:0@lo:104: 00000100:00100000:0.0:1788874014.115049:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788874014.115057:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859188864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788874014.115079:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874014.116897:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874014.116930:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188736 00000100:00100000:2.0:1788874014.116941:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188736 00010000:00010000:2.0:1788874014.118152:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 24 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874014.118200:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188864 00000100:00100000:2.0:1788874014.118220:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188864 00010000:00010000:2.0:1788874014.118235:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 25 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874014.118259:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788874014.118269:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+25:3636:x1875769859188736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788874014.118286:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874014.118292:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 25 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.118312:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 25 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.118337:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d345fd93000/0x25c660afb0a9ca04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c9fd expref: 25 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.118357:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874014.118434:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+24:3636:x1875769859188736:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (3567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874014.118441:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788874014.118462:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788874014.118486:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+23:3636:x1875769859188864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788874014.118493:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874014.118496:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 23 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.118502:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 23 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.118509:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3343ad8400/0x25c660afb0a9c96a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c963 expref: 23 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.118517:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874014.118534:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a50e61a-7558-480a-b914-36a6e76b41da+22:3636:x1875769859188864:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874014.118538:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788874014.119279:0:20183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859187968:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788874014.119296:0:20183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f3a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20183:1875769859188096:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788874014.119341:0:20183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.120036:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189120 00000100:00100000:3.0:1788874014.120056:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189120 00010000:00010000:3.0:1788874014.120088:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 22 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874014.120111:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874014.120115:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788874014.120123:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a50e61a-7558-480a-b914-36a6e76b41da+22:3634:x1875769859189120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788874014.120137:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874014.120142:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 22 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.120153:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 22 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.120171:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f442800/0x25c660afb0a9c91d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c916 expref: 22 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.120224:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874014.120276:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a50e61a-7558-480a-b914-36a6e76b41da+21:3634:x1875769859189120:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874014.120284:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788874014.120299:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859188992 00000100:00100000:3.0:1788874014.120302:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859188992 00010000:00010000:3.0:1788874014.120315:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 21 pid: 17149 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.120328:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874014.120333:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a50e61a-7558-480a-b914-36a6e76b41da+21:3633:x1875769859188992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788874014.120340:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874014.120344:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 21 pid: 17149 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.120352:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 21 pid: 17149 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.120361:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3475eca200/0x25c660afb0a9c92b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c660afb0a9c924 expref: 21 pid: 17149 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874014.120370:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874014.120396:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a50e61a-7558-480a-b914-36a6e76b41da+20:3633:x1875769859188992:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874014.120401:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788874014.120540:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a50e61a-7558-480a-b914-36a6e76b41da:3633:1875769859188992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788874014.120579:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a50e61a-7558-480a-b914-36a6e76b41da:3634:1875769859189120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788874014.120604:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859188864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788874014.120612:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a50e61a-7558-480a-b914-36a6e76b41da:3636:1875769859188736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788874014.120653:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874014.120868:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874014.121448:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233344 00000100:00100000:3.0:1788874014.121457:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233344 00010000:00010000:3.0:1788874014.121487:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 13 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874014.121762:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233472 00000100:00100000:3.0:1788874014.121767:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233472 00010000:00010000:3.0:1788874014.121785:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 14 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874014.121952:0:19491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:1.0:1788874014.121966:0:19491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a6e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a1c553-66f3-4674-b9cc-0bbc78015451+14:2401:x1875769840233344:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788874014.121983:0:19491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874014.121989:0:19491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 14 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122002:0:19491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 14 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122020:0:19491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3441652a00/0x25c660afb0a9cc57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a73 expref: 14 pid: 17150 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122051:0:19491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788874014.122122:0:19491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a6e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a1c553-66f3-4674-b9cc-0bbc78015451+13:2401:x1875769840233344:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 160us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874014.122129:0:19491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 13 00000100:00100000:1.0:1788874014.122182:0:19491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:1.0:1788874014.122189:0:19491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a1c553-66f3-4674-b9cc-0bbc78015451+12:2400:x1875769840233472:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788874014.122228:0:19491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874014.122629:0:19491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 12 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122641:0:19491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 12 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122654:0:19491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d33434de600/0x25c660afb0a9cc18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a03 expref: 12 pid: 17148 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122679:0:19491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122689:0:19491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122704:0:19491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122710:0:19491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122715:0:19491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122720:0:19491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122724:0:19491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443400 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874014.122727:0:19491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122754:0:19491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.122778:0:19491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.122969:0:20183:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.122979:0:20183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874014.122987:0:20183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d347f443400/0x25c660afb0a9cc88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874014.125319:0:19491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788874014.125418:0:19491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a1c553-66f3-4674-b9cc-0bbc78015451+11:2400:x1875769840233472:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 3220us (4541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874014.125433:0:19491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 14 00010000:00010000:2.0:1788874014.830611:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788874015.415521:0:17152:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788874015.415530:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d347a75c800 from 13 10000000:01000000:1.0:1788874015.415536:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788874015.415588:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.415599:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.415610:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.415637:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.416511:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.416619:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58300 going to sleep for 11 seconds 00000100:00100000:3.0:1788874015.420227:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189248 00000100:00100000:3.0:1788874015.420242:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189248 00000100:00100000:3.0:1788874015.421950:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788874015.421966:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+20:17152:x1875769859189248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874015.421984:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874015.422003:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443800/0x25c660afb0a9cc96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9cc8f expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.422094:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443800/0x25c660afb0a9cc96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9cc8f expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.422106:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443800/0x25c660afb0a9cc96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9cc8f expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.422116:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443800, rc 0) 00000100:00100000:3.0:1788874015.422189:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859189248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.422197:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788874015.422302:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788874015.422323:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9cc96 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.422347:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9cc96 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.422531:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.422557:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.422610:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58300 going to sleep for 11 seconds 00000100:00100000:0.0:1788874015.422640:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189376 00000100:00100000:0.0:1788874015.422644:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189376 00000100:00100000:1.0:1788874015.422764:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788874015.422773:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859189376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.422915:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859189376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874015.422921:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788874015.423000:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874015.423087:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788874015.423130:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874015.423156:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874015.423268:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189504 00000100:00100000:1.0:1788874015.423273:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189504 00000100:00100000:1.0:1788874015.423306:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788874015.423314:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859189504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.423512:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859189504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874015.423519:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788874015.423704:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788874015.425142:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788874015.425250:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788874015.425271:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788874015.425283:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9cc96 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874015.425295:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d33434dea00/0x25c660afb0a9cc8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9cc96 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874015.425317:0:17152:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788874015.425319:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3480d47000 from 13 10000000:01000000:0.0:1788874015.425417:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788874015.425452:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874015.425461:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874015.425472:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874015.425491:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788874015.425536:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874015.425569:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874015.425574:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189632 00000100:00100000:2.0:1788874015.425579:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189632 00000100:00100000:2.0:1788874015.425618:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788874015.425627:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+21:17152:x1875769859189632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788874015.425639:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874015.425660:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441653e00/0x25c660afb0a9cca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9cc9d expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874015.425678:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441653e00/0x25c660afb0a9cca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9cc9d expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874015.425685:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441653e00/0x25c660afb0a9cca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9cc9d expref: 22 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874015.425691:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653e00, rc 0) 00000100:00100000:2.0:1788874015.425725:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859189632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874015.425740:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788874015.425760:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788874015.425772:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9cca4 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874015.425781:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9cca4 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874015.425824:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874015.425843:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874015.425859:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874015.425928:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189760 00000100:00100000:1.0:1788874015.425932:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189760 00000100:00100000:0.0:1788874015.425978:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788874015.425986:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859189760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874015.426097:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859189760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874015.426104:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788874015.426114:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.426141:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.426178:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.426201:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874015.426354:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859189888 00000100:00100000:2.0:1788874015.426359:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859189888 00000100:00100000:2.0:1788874015.426391:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788874015.426398:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859189888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788874015.426543:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859189888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874015.426551:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788874015.426551:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859189888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788874015.427608:0:20255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788874015.427746:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788874015.427775:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788874015.427785:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9cca4 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.427794:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d3341e25400/0x25c660afb0a9cc9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9cca4 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874015.427805:0:17152:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788874015.427808:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3475f37800 from 13 10000000:01000000:1.0:1788874015.427810:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788874015.427835:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.427843:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.427864:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.427884:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.427927:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874015.428000:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190016 00000100:00100000:3.0:1788874015.428006:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190016 00000100:00100000:3.0:1788874015.428116:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788874015.428124:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+22:17152:x1875769859190016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874015.428143:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874015.428154:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f442800/0x25c660afb0a9ccb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9ccab expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.428174:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f442800/0x25c660afb0a9ccb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9ccab expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.428186:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f442800/0x25c660afb0a9ccb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9ccab expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.428192:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788874015.428195:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442800, rc 0) 00000100:00100000:3.0:1788874015.428260:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859190016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.428267:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788874015.428283:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788874015.428298:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ccb2 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.428307:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9ccb2 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.428364:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.428505:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.428534:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874015.428697:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190144 00000100:00100000:3.0:1788874015.428701:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190144 00000100:00100000:3.0:1788874015.428741:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788874015.428750:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859190144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874015.428850:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859190144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.428857:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788874015.429063:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.429151:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.429187:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.429224:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874015.429245:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190272 00000100:00100000:3.0:1788874015.429249:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190272 00000100:00100000:3.0:1788874015.429275:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788874015.429283:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859190272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788874015.429362:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859190272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.429377:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788874015.429394:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788874015.431029:0:20256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788874015.431106:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788874015.431124:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788874015.431135:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ccb2 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431146:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d33434df000/0x25c660afb0a9ccab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ccb2 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874015.431157:0:17152:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788874015.431159:0:17152:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3442ab2000 from 13 10000000:01000000:1.0:1788874015.431162:0:17152:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788874015.431190:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431198:0:17152:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431236:0:17152:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.431256:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.431302:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.431335:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874015.431352:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190400 00000100:00100000:1.0:1788874015.431357:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190400 00000100:00100000:1.0:1788874015.431412:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788874015.431420:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+23:17152:x1875769859190400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788874015.431432:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874015.431444:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d33434dec00/0x25c660afb0a9ccc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c660afb0a9ccb9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431465:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d33434dec00/0x25c660afb0a9ccc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c660afb0a9ccb9 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431475:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d33434dec00/0x25c660afb0a9ccc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c660afb0a9ccb9 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431484:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434dec00, rc 0) 00000100:00100000:1.0:1788874015.431517:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859190400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874015.431523:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788874015.431563:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788874015.431576:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ccc0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.431591:0:17152:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c660afb0a9ccc0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874015.431636:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.431676:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.431697:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788874015.431704:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190528 00000100:00100000:3.0:1788874015.431709:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190528 00000100:00100000:3.0:1788874015.431754:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788874015.431889:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859190528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874015.432001:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859190528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.432008:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788874015.432509:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.432737:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.432782:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874015.432815:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874015.435827:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190656 00000100:00100000:2.0:1788874015.435842:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190656 00000100:00100000:2.0:1788874015.435904:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788874015.435918:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859190656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788874015.436090:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:17152:x1875769859190656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874015.436099:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788874015.436155:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a50e61a-7558-480a-b914-36a6e76b41da:17152:1875769859190656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788874015.437429:0:20258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788874015.437699:0:17152:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788874015.437723:0:17152:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788874015.437742:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ccc0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874015.437751:0:17152:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.120@tcp lock: ffff9d33434de600/0x25c660afb0a9ccb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c660afb0a9ccc0 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874015.761892:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874015.762098:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233600 00000100:00100000:2.0:1788874015.762113:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233600 00000100:00100000:2.0:1788874015.762184:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 156 00000100:00100000:2.0:1788874015.762196:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3480d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+11:14916:x1875769840233600:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788874015.762245:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874015.762267:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3441653a00/0x25c660afb0a9ccc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9aab expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874015.762298:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3441653a00/0x25c660afb0a9ccc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aab expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874015.762311:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3441653a00/0x25c660afb0a9ccc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aab expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874015.762322:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653a00, rc 0) 00000100:00100000:2.0:1788874015.762391:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3480d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+12:14916:x1875769840233600:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 197us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874015.762399:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 156 00000100:00100000:1.0:1788874015.774644:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874015.774706:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233728 00000100:00100000:2.0:1788874015.774716:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233728 00000100:00100000:2.0:1788874015.774785:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 157 00000100:00100000:2.0:1788874015.774796:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+12:14916:x1875769840233728:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788874015.774969:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+12:14916:x1875769840233728:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874015.774977:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 157 00000100:00100000:3.0:1788874015.777033:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874015.777183:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233856 00000100:00100000:1.0:1788874015.777192:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233856 00000100:00100000:1.0:1788874015.777275:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 158 00000100:00100000:1.0:1788874015.777285:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+12:14916:x1875769840233856:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.777415:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+12:14916:x1875769840233856:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874015.777430:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 158 00000100:00100000:1.0:1788874015.798277:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874015.798358:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840233984 00000100:00100000:3.0:1788874015.798368:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840233984 00000100:00100000:3.0:1788874015.798426:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 159 00000100:00100000:3.0:1788874015.798437:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+12:14916:x1875769840233984:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874015.798456:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874015.798480:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d347f443400/0x25c660afb0a9ccce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ab2 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.798516:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d347f443400/0x25c660afb0a9ccce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ab2 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.798527:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d347f443400/0x25c660afb0a9ccce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ab2 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874015.798537:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443400, rc 0) 00000100:00100000:3.0:1788874015.798600:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24a1c553-66f3-4674-b9cc-0bbc78015451+13:14916:x1875769840233984:12345-192.168.202.20@tcp:101:ll_cfg_requeue.0 Request processed in 165us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.798607:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 159 00000100:00100000:2.0:1788874015.802511:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874015.802579:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840234112 00000100:00100000:3.0:1788874015.802590:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840234112 00000100:00100000:3.0:1788874015.802651:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 160 00000100:00100000:3.0:1788874015.802662:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+13:14916:x1875769840234112:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874015.802832:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24a1c553-66f3-4674-b9cc-0bbc78015451+13:14916:x1875769840234112:12345-192.168.202.20@tcp:501:ll_cfg_requeue.0 Request processed in 171us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874015.802841:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 160 00000100:00100000:3.0:1788874015.808790:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874015.813107:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840234240 00000100:00100000:1.0:1788874015.813128:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840234240 00000100:00100000:1.0:1788874015.813344:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 161 00000100:00100000:1.0:1788874015.813356:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+13:14916:x1875769840234240:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874015.813541:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+13:14916:x1875769840234240:12345-192.168.202.20@tcp:503:ll_cfg_requeue.0 Request processed in 187us (4760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874015.813551:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 161 00010000:00010000:2.0:1788874015.854492:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874016.496177:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788874016.496231:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859190784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788874016.496309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874016.496436:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190784 00000100:00100000:3.0:1788874016.496445:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190784 00000100:00100000:3.0:1788874016.496515:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788874016.496526:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859190784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788874016.496567:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788874016.496616:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859190784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874016.496623:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788874016.497395:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788874016.497437:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859190784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788874016.497999:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859190912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788874016.498050:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874016.498142:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859190912 00000100:00100000:3.0:1788874016.498150:0:19948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859190912 00000100:00100000:3.0:1788874016.498225:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788874016.498235:0:19948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859190912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788874016.498260:0:19948:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788874016.498300:0:19948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859190912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874016.498306:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788874016.498366:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788874016.498396:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859190912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788874016.498444:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859191040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788874016.498471:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.498535:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191040 00000100:00100000:1.0:1788874016.498540:0:19948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191040 00000100:00100000:1.0:1788874016.498586:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788874016.498594:0:19948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859191040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788874016.498605:0:19948:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788874016.498644:0:19948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859191040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874016.498651:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788874016.498665:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859191040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788874016.498841:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859191552:0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.498874:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874016.498893:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859192064:0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.498930:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874016.498950:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788874016.498956:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859191424:0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.498977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874016.498991:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859191936:0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.499009:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874016.499036:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859192064 00000100:00100000:2.0:1788874016.499040:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859192064 00000100:00100000:2.0:1788874016.499068:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191424 00000100:00100000:2.0:1788874016.499072:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191424 00000100:00100000:2.0:1788874016.499085:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191936 00000100:00100000:2.0:1788874016.499087:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191936 00000100:00100000:2.0:1788874016.499100:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788874016.499106:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859192064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.499143:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875769859192064:12345-0@lo:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874016.499166:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788874016.499182:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788874016.499188:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859191424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.499241:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859191424:12345-0@lo:400:kworker.0 Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874016.499248:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788874016.499261:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788874016.499266:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859191936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.499290:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859191936:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874016.499296:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788874016.499331:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859191424:0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.499340:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859191936:0@lo:400:kworker.0 00010000:00080000:2.0:1788874016.499351:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334359e300 x1875769859192064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874016.499362:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1875769859192064:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499440:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859191168:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.499512:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859191680:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499540:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.499558:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859192192:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499578:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.499596:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788874016.499601:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859191296:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499623:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.499638:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859191808:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.499673:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859192320:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499693:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874016.499727:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191680 00000100:00100000:1.0:1788874016.499731:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191680 00000100:00100000:1.0:1788874016.499760:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788874016.499766:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859191680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499802:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859191680:12345-0@lo:400:kworker.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874016.499807:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788874016.499824:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859192192 00000100:00100000:1.0:1788874016.499828:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859192192 00000100:00100000:1.0:1788874016.499843:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191808 00000100:00100000:1.0:1788874016.499846:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191808 00000100:00100000:1.0:1788874016.499855:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859192320 00000100:00100000:1.0:1788874016.499857:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859192320 00000100:00100000:1.0:1788874016.499869:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788874016.499875:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859192192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499904:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859192192:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874016.499917:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788874016.499930:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788874016.499935:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d33441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859191808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.499960:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d33441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875769859191808:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874016.499965:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788874016.499976:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788874016.499981:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859192320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.500004:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875769859192320:12345-0@lo:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874016.500010:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788874016.500042:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875769859191808:0@lo:400:kworker.0 00010000:00080000:1.0:1788874016.500052:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d334359e680 x1875769859192320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874016.500061:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1875769859192320:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.500069:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859191680:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.500076:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859192192:0@lo:400:kworker.0 00000100:00080000:0.0:1788874016.500168:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788874016.500173:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788874016.500175:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788874016.500177:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788874016.502386:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191168 00000100:00100000:2.0:1788874016.502402:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191168 00000100:00100000:2.0:1788874016.502468:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788874016.502478:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:3635:x1875769859191168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874016.502561:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a50e61a-7558-480a-b914-36a6e76b41da+24:3635:x1875769859191168:12345-0@lo:400:kworker.0 Request processed in 85us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874016.502568:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788874016.502876:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859191168:0@lo:400:kworker.0 00000100:00100000:3.0:1788874016.504950:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191552 00000100:00100000:3.0:1788874016.504978:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191552 00000100:00100000:3.0:1788874016.505038:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859191296 00000100:00100000:3.0:1788874016.505042:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859191296 00000100:00100000:3.0:1788874016.505060:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788874016.505069:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859191552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874016.505170:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875769859191552:12345-0@lo:400:kworker.0 Request processed in 101us (6294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874016.505177:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788874016.505193:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788874016.505200:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859191296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788874016.505274:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859191296:12345-0@lo:400:kworker.0 Request processed in 74us (5649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874016.505280:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788874016.505394:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1875769859191552:0@lo:400:kworker.0 00000100:00100000:1.0:1788874016.507151:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859191296:0@lo:400:kworker.0 00010000:00010000:0.0:1788874016.881192:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874016.963480:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874016.964035:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840234368 00000100:00100000:1.0:1788874016.964046:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840234368 00000100:00100000:1.0:1788874016.964136:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:1.0:1788874016.964161:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:15583:x1875769840234368:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788874016.964185:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788874016.964199:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788874016.964257:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9ccd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ab9 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964324:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964340:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964354:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964368:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964374:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964381:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964468:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df200/0x25c660afb0a9ccea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964477:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df200/0x25c660afb0a9ccea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964484:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df200/0x25c660afb0a9ccea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874016.964524:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788874016.964528:0:17156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788874016.964566:0:17156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df200/0x25c660afb0a9ccea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964579:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964585:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964591:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964596:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874016.964600:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964607:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964618:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:1.0:1788874016.964621:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874016.964625:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964631:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964644:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964659:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964665:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964670:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874016.964673:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964679:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964688:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d33410dfb00) 00010000:00010000:1.0:1788874016.964690:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874016.964693:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964699:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964742:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9ccd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ab9 expref: 8 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964756:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df200/0x25c660afb0a9ccea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ab9 expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.964763:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d33410dfe00) 00010000:00010000:1.0:1788874016.964766:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788874016.964774:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434df200, rc 0) 00000100:00100000:1.0:1788874016.964844:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:15583:x1875769840234368:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 686us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874016.964852:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:0.0:1788874016.967337:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874016.967734:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840234496 00000100:00100000:2.0:1788874016.967750:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840234496 00000100:00100000:2.0:1788874016.967994:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:2.0:1788874016.968007:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:15583:x1875769840234496:12345-192.168.202.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788874016.968112:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:15583:x1875769840234496:12345-192.168.202.20@tcp:900:lhsmtool_posix.0 Request processed in 107us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874016.968122:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:3.0:1788874016.970012:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874016.970728:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840234752 00000100:00100000:1.0:1788874016.970746:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840234752 00000100:00100000:1.0:1788874016.970831:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:1.0:1788874016.970843:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:15583:x1875769840234752:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788874016.970869:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874016.970891:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9ccf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ac0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.970980:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.970996:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971010:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971075:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971083:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971089:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971233:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfa00/0x25c660afb0a9cd06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971258:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfa00/0x25c660afb0a9cd06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971266:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfa00/0x25c660afb0a9cd06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874016.971278:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788874016.971424:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971432:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971438:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971444:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874016.971448:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971455:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971468:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d33410dfe00) 00010000:00010000:1.0:1788874016.971471:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874016.971476:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971482:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9ccf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971494:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971505:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971510:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971514:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874016.971517:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971522:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971530:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d33410dfb00) 00010000:00010000:1.0:1788874016.971532:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874016.971535:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.971540:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9ccff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.972478:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9ccf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ac0 expref: 10 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.972503:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfa00/0x25c660afb0a9cd06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ac0 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874016.972511:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d33410df100) 00010000:00010000:1.0:1788874016.972513:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874016.972524:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434dfa00, rc 0) 00000100:00100000:1.0:1788874016.972595:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15583:x1875769840234752:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 1753us (2597us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788874016.972604:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:0.0:1788874016.978412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874016.978677:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840234880 00000100:00100000:2.0:1788874016.978692:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840234880 00000100:00100000:2.0:1788874016.978856:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:2.0:1788874016.978870:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15583:x1875769840234880:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788874016.979017:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15583:x1875769840234880:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 Request processed in 150us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874016.979026:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:0.0:1788874016.983270:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874016.986539:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235008 00000100:00100000:3.0:1788874016.986566:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235008 00000100:00100000:3.0:1788874016.986740:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:3.0:1788874016.986755:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:15583:x1875769840235008:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788874016.987325:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788874016.988662:0:17155:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1845us 00000100:00100000:3.0:1788874017.007554:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.007743:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235136 00000100:00100000:1.0:1788874017.007758:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235136 00000100:00100000:1.0:1788874017.007837:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:1.0:1788874017.007852:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15589:x1875769840235136:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788874017.007882:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.007912:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ac7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008000:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008018:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008033:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008047:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008052:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008057:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008099:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008119:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008124:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008128:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.008132:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008139:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008149:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:1.0:1788874017.008151:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.008155:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008160:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008171:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008174:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008178:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008181:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.008186:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008191:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008195:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d33410dfb00) 00010000:00010000:1.0:1788874017.008196:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.008197:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008201:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008267:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ac7 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008275:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:1.0:1788874017.008276:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.008279:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ac7 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.008286:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434dfc00, rc 0) 00000100:00100000:1.0:1788874017.008347:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15589:x1875769840235136:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 501us (806us total) trans 0 rc 301/301 00000100:00100000:1.0:1788874017.008353:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 27 00000100:00100000:2.0:1788874017.013198:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874017.014942:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:15583:x1875769840235008:12345-192.168.202.20@tcp:59:lhsmtool_posix.0 Request processed in 28179us (31674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874017.014967:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:0.0:1788874017.017070:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235264 00000100:00100000:0.0:1788874017.017084:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235264 00000100:00100000:0.0:1788874017.017150:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:0.0:1788874017.017161:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15589:x1875769840235264:12345-192.168.202.20@tcp:700:lfs.0 00000100:00100000:0.0:1788874017.017275:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15589:x1875769840235264:12345-192.168.202.20@tcp:700:lfs.0 Request processed in 114us (4092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874017.017283:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:3.0:1788874017.018552:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.018702:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235520 00000100:00100000:1.0:1788874017.018724:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235520 00000100:00100000:1.0:1788874017.018836:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 28 00000100:00100000:1.0:1788874017.018846:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:15589:x1875769840235520:12345-192.168.202.20@tcp:36:lfs.0 00010000:00010000:1.0:1788874017.018931:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874017.018966:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cc42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9a34 expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.018989:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:1.0:1788874017.018996:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788874017.019075:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.019092:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 5 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.019102:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.019143:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 5 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.019159:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 5 pid: 17157 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.019177:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859192448:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788874017.019531:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d58780 going to sleep for 11 seconds 00000100:00100000:3.0:1788874017.021162:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874017.021269:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235648 00000100:00100000:0.0:1788874017.021280:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235648 00010000:00010000:0.0:1788874017.021361:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 6 pid: 17157 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874017.021420:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:0.0:1788874017.021433:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840235648:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788874017.021452:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874017.021460:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 6 pid: 17157 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.021476:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 6 pid: 17157 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.021507:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:0.0:1788874017.021513:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.021544:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.021554:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.021579:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788874017.021807:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788874017.022029:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ca012d0-0acd-4ca6-971d-710455c35699+6:2400:x1875769840235648:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 596us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874017.022039:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00010000:00010000:1.0:1788874017.022352:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cc81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aa4 expref: 5 pid: 17157 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.022374:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859192448:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788874017.022408:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.022432:0:17157:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.022439:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.022468:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.022483:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.022493:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024135:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024156:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024166:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788874017.024199:0:17157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051f2267a reply state 000000007441e170 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024521:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024529:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:1.0:1788874017.024543:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788874017.024548:0:17157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788874017.024554:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788874017.024565:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024572:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024578:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024584:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dfc00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.024589:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024596:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024605:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3476dc6400) 00010000:00010000:1.0:1788874017.024608:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.024612:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024619:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788874017.024636:0:17157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051f2267a reply state 000000007441e170 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024645:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.024662:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d33410dfb00) 00010000:00010000:1.0:1788874017.024664:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788874017.024666:0:17157:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788874017.024793:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+10:15589:x1875769840235520:12345-192.168.202.20@tcp:36:lfs.0 Request processed in 5943us (6245us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788874017.024802:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 28 00000040:00080000:0.0:1788874017.074972:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788874017.102400:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.102537:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235776 00000100:00100000:1.0:1788874017.102556:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235776 00000100:00100000:1.0:1788874017.102645:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:1.0:1788874017.102656:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+10:15597:x1875769840235776:12345-192.168.202.20@tcp:101:lctl.0 00010000:00010000:1.0:1788874017.102692:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.102753:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ace expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.102825:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfe00/0x25c660afb0a9cd45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.102839:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfe00/0x25c660afb0a9cd45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.102853:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfe00/0x25c660afb0a9cd45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.102897:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788874017.102901:0:17156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788874017.102938:0:17156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfe00/0x25c660afb0a9cd45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.102964:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ace expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.103000:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfe00/0x25c660afb0a9cd45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ace expref: 11 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.103009:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:1.0:1788874017.103012:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788874017.103016:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434dfe00, rc 0) 00000100:00100000:1.0:1788874017.103100:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+11:15597:x1875769840235776:12345-192.168.202.20@tcp:101:lctl.0 Request processed in 446us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.103108:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 29 00000100:00100000:3.0:1788874017.132879:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874017.132956:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840235904 00000100:00100000:2.0:1788874017.132970:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840235904 00000100:00100000:2.0:1788874017.133174:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:2.0:1788874017.133186:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ca012d0-0acd-4ca6-971d-710455c35699+5:15598:x1875769840235904:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788874017.133257:0:20047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874017.133289:0:20047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cd4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ad5 expref: -99 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.133363:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cd53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.133402:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cd53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.133419:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cd53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788874017.133483:0:20047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788874017.133488:0:20047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788874017.133519:0:20047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cd53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.133546:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cd4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ad5 expref: 7 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.133568:0:20047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653200/0x25c660afb0a9cd53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ad5 expref: 6 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.133578:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:2.0:1788874017.133582:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788874017.133586:0:20047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653200, rc 0) 00000100:00100000:2.0:1788874017.133683:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ca012d0-0acd-4ca6-971d-710455c35699+6:15598:x1875769840235904:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 497us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874017.133700:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 30 00000100:00100000:3.0:1788874017.137328:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874017.137796:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840236032 00000100:00100000:0.0:1788874017.137813:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840236032 00000100:00100000:0.0:1788874017.137956:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:0.0:1788874017.137968:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ca012d0-0acd-4ca6-971d-710455c35699+6:15598:x1875769840236032:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788874017.137998:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874017.138031:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25200/0x25c660afb0a9cd5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9adc expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138108:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138124:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138137:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138147:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138174:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138181:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138339:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24800/0x25c660afb0a9cd6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138349:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24800/0x25c660afb0a9cd6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.138356:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24800/0x25c660afb0a9cd6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788874017.139597:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788874017.139610:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788874017.139701:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24800/0x25c660afb0a9cd6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139731:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139740:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139749:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139755:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3341e25a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788874017.139761:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139790:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139811:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:0.0:1788874017.139814:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788874017.139821:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139828:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cd61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139849:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139853:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139857:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139860:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3341e25e00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:0.0:1788874017.139862:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139865:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139870:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d33410dfb00) 00010000:00010000:0.0:1788874017.139872:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788874017.139874:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139885:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cd68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139921:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25200/0x25c660afb0a9cd5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9adc expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139931:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24800/0x25c660afb0a9cd6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9adc expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.139937:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:0.0:1788874017.139938:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788874017.139940:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3341e24800, rc 0) 00000100:00100000:0.0:1788874017.140023:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ca012d0-0acd-4ca6-971d-710455c35699+7:15598:x1875769840236032:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 2056us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874017.140032:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 31 00000100:00100000:0.0:1788874017.143188:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.143251:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840236160 00000100:00100000:3.0:1788874017.143265:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840236160 00000100:00080000:2.0:1788874017.143324:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788874017.143373:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:3.0:1788874017.143386:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6ca012d0-0acd-4ca6-971d-710455c35699+5:15598:x1875769840236160:12345-192.168.202.20@tcp:900:lfs.0 00000100:00100000:3.0:1788874017.143503:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6ca012d0-0acd-4ca6-971d-710455c35699+5:15598:x1875769840236160:12345-192.168.202.20@tcp:900:lfs.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874017.143511:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:3.0:1788874017.146815:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.146957:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840236416 00000100:00100000:1.0:1788874017.146970:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840236416 00000100:00100000:1.0:1788874017.147095:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 32 00000100:00100000:1.0:1788874017.147106:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+7:15598:x1875769840236416:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:1.0:1788874017.147135:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.147165:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9ae3 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.147334:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788874017.147467:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ae3 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.147481:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:1.0:1788874017.147484:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788874017.147489:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cd76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9ae3 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.147522:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434dfc00, rc 0) 00000100:00100000:1.0:1788874017.147598:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ca012d0-0acd-4ca6-971d-710455c35699+8:15598:x1875769840236416:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 493us (1038us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788874017.147616:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 32 00000100:00100000:0.0:1788874017.151549:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.151789:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840236672 00000100:00100000:1.0:1788874017.151804:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840236672 00000100:00100000:1.0:1788874017.151888:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:1.0:1788874017.151901:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+8:15598:x1875769840236672:12345-192.168.202.20@tcp:36:lfs.0 00010000:00010000:1.0:1788874017.151988:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874017.152026:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24800/0x25c660afb0a9cd6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9adc expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.152053:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:1.0:1788874017.152059:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788874017.152088:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.152103:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.152113:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788874017.152551:0:17156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cd65309 reply state 000000004d6ab3ee transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.152564:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.152739:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:1.0:1788874017.152743:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788874017.152747:0:17156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788874017.152758:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788874017.153193:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+9:15598:x1875769840236672:12345-192.168.202.20@tcp:36:lfs.0 Request processed in 1291us (1656us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788874017.153241:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 33 00000100:00100000:0.0:1788874017.155417:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.155526:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840236928 00000100:00100000:3.0:1788874017.155536:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840236928 00000100:00100000:3.0:1788874017.155630:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:3.0:1788874017.155654:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6ca012d0-0acd-4ca6-971d-710455c35699+9:15598:x1875769840236928:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:3.0:1788874017.155970:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6ca012d0-0acd-4ca6-971d-710455c35699+10:15598:x1875769840236928:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 329us (568us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788874017.155978:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:0.0:1788874017.160953:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874017.161032:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840237184 00000100:00100000:2.0:1788874017.161046:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840237184 00000100:00100000:2.0:1788874017.161162:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:2.0:1788874017.161177:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ca012d0-0acd-4ca6-971d-710455c35699+10:15598:x1875769840237184:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788874017.161267:0:20047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874017.161295:0:20047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cd8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9aea expref: -99 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161380:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161405:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161417:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161425:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161430:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161434:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788874017.161561:0:20047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788874017.161895:0:20047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161903:0:20047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161910:0:20047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161933:0:20047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874017.161938:0:20047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161948:0:20047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161965:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:2.0:1788874017.161968:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874017.161975:0:20047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161982:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9cd92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.161996:0:20047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162000:0:20047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162004:0:20047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162007:0:20047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874017.162009:0:20047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162012:0:20047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162025:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d33410dfb00) 00010000:00010000:2.0:1788874017.162027:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874017.162029:0:20047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162033:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cd99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162067:0:20047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cd8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aea expref: 12 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162073:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:2.0:1788874017.162074:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788874017.162077:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cd8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aea expref: 12 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.162083:0:20047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652800, rc 0) 00000100:00100000:2.0:1788874017.162153:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ca012d0-0acd-4ca6-971d-710455c35699+11:15598:x1875769840237184:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 981us (1214us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788874017.162161:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 34 00000100:00100000:1.0:1788874017.165445:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874017.165529:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840237312 00000100:00100000:0.0:1788874017.165542:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840237312 00000100:00100000:0.0:1788874017.165620:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788874017.165633:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ca012d0-0acd-4ca6-971d-710455c35699+11:15598:x1875769840237312:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:0.0:1788874017.165805:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874017.165836:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cda7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9af1 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.165970:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.165985:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.165996:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788874017.166018:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788874017.166021:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788874017.166040:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.166062:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25e00/0x25c660afb0a9cda7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.166077:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874017.166084:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:0.0:1788874017.166087:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788874017.166090:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3341e25a00, rc 0) 00000100:00100000:0.0:1788874017.166164:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ca012d0-0acd-4ca6-971d-710455c35699+12:15598:x1875769840237312:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 534us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874017.166169:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 35 00000100:00100000:0.0:1788874017.169968:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.170055:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840237440 00000100:00100000:1.0:1788874017.170072:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840237440 00000100:00100000:1.0:1788874017.170154:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:1.0:1788874017.170166:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ca012d0-0acd-4ca6-971d-710455c35699+12:15598:x1875769840237440:12345-192.168.202.20@tcp:37:lfs.0 00000100:00100000:1.0:1788874017.174504:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ca012d0-0acd-4ca6-971d-710455c35699+12:15598:x1875769840237440:12345-192.168.202.20@tcp:37:lfs.0 Request processed in 4322us (4531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.174523:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 3 00000100:00100000:1.0:1788874017.179380:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.179514:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840237696 00000100:00100000:3.0:1788874017.179529:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840237696 00000100:00100000:2.0:1788874017.179772:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:2.0:1788874017.179788:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a446850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6ca012d0-0acd-4ca6-971d-710455c35699+12:15598:x1875769840237696:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:2.0:1788874017.180088:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a446850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6ca012d0-0acd-4ca6-971d-710455c35699+13:15598:x1875769840237696:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 300us (721us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788874017.180097:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 4 00000100:00100000:0.0:1788874017.229489:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.229893:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840237824 00000100:00100000:1.0:1788874017.229907:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840237824 00000100:00100000:1.0:1788874017.229990:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:1.0:1788874017.230003:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+11:15604:x1875769840237824:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:1.0:1788874017.230032:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.230063:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cdb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9af8 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230153:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230185:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230201:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230377:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230395:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230403:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230515:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de400/0x25c660afb0a9cdca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230525:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de400/0x25c660afb0a9cdca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.230532:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de400/0x25c660afb0a9cdca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.230577:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788874017.230581:0:17157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788874017.231037:0:17157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de400/0x25c660afb0a9cdca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231055:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231076:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231085:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231091:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de000 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.231097:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231107:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231124:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:1.0:1788874017.231128:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.231135:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231141:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de000/0x25c660afb0a9cdbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231162:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231168:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231175:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231180:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434df800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.231190:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231196:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231398:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d33410dfb00) 00010000:00010000:1.0:1788874017.231402:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.231406:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231412:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df800/0x25c660afb0a9cdc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231455:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dfc00/0x25c660afb0a9cdb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af8 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231472:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de400/0x25c660afb0a9cdca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af8 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.231479:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:1.0:1788874017.231482:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788874017.231485:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d33434de400, rc 0) 00000100:00100000:1.0:1788874017.231606:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+12:15604:x1875769840237824:12345-192.168.202.20@tcp:101:bash.0 Request processed in 1596us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.231619:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 36 00000100:00100000:2.0:1788874017.234247:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.234363:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840237952 00000100:00100000:3.0:1788874017.234375:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840237952 00000100:00100000:3.0:1788874017.234444:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:3.0:1788874017.234455:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:15604:x1875769840237952:12345-192.168.202.20@tcp:900:bash.0 00000100:00100000:3.0:1788874017.234552:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:15604:x1875769840237952:12345-192.168.202.20@tcp:900:bash.0 Request processed in 99us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874017.234558:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:2.0:1788874017.237320:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.237492:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840238208 00000100:00100000:1.0:1788874017.237507:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840238208 00000100:00100000:1.0:1788874017.237590:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:1.0:1788874017.237617:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+12:15604:x1875769840238208:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:1.0:1788874017.237662:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.237693:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de200/0x25c660afb0a9cdd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9aff expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.237876:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.237897:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.237909:0:17156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.237959:0:17156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.237977:0:17156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 12 pid: 17155 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.237996:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1875769859192576:192.168.202.20@tcp:104: 00000100:00100000:1.0:1788874017.238114:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d345840a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788874017.242062:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1875769859192576:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788874017.242109:0:17156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874017.244412:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.244579:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840238336 00000100:00100000:3.0:1788874017.244594:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840238336 00010000:00010000:3.0:1788874017.244674:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 13 pid: 17155 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874017.244829:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:3.0:1788874017.244843:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ca012d0-0acd-4ca6-971d-710455c35699+13:2401:x1875769840238336:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788874017.244864:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874017.244873:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 13 pid: 17155 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.244890:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 13 pid: 17155 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.244920:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25a00/0x25c660afb0a9cdae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9af1 expref: 13 pid: 17155 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.244946:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:3.0:1788874017.244952:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.244965:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.244975:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.245074:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874017.245150:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ca012d0-0acd-4ca6-971d-710455c35699+12:2401:x1875769840238336:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 309us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874017.245159:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00010000:00010000:1.0:1788874017.247197:0:17156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.247243:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.247308:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.247327:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.247341:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248277:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248297:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248308:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.248323:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788874017.248356:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248363:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248370:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248376:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca200 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.248382:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248579:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248597:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:1.0:1788874017.248601:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874017.248730:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248739:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdd8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788874017.248758:0:17156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a1bd49f reply state 0000000069da87c6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248772:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248779:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d33410df300) 00010000:00010000:1.0:1788874017.248781:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788874017.248784:0:17156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788874017.248900:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de200/0x25c660afb0a9cdd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 15 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248921:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 14 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.248930:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.248932:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788874017.248935:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecaa00, rc 0) 00000100:00100000:1.0:1788874017.249038:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+15:15604:x1875769840238208:12345-192.168.202.20@tcp:101:bash.0 Request processed in 11437us (11734us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788874017.249049:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 37 00000100:00100000:2.0:1788874017.262517:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.262670:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840238464 00000100:00100000:1.0:1788874017.262684:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840238464 00000100:00100000:1.0:1788874017.262779:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 38 00000100:00100000:1.0:1788874017.262791:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+15:15604:x1875769840238464:12345-192.168.202.20@tcp:101:bash.0 00010000:00010000:1.0:1788874017.262841:0:20047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.262882:0:20047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b06 expref: -99 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.262991:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.263010:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.263025:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.263089:0:20047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788874017.263094:0:20047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788874017.263119:0:20047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.263133:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.263168:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9cdf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 17 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.263261:0:20047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 16 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.263272:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.263276:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788874017.263281:0:20047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecba00, rc 0) 00000100:00100000:1.0:1788874017.263359:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+16:15604:x1875769840238464:12345-192.168.202.20@tcp:101:bash.0 Request processed in 570us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.263367:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 38 00000100:00100000:0.0:1788874017.267338:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.267570:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840238720 00000100:00100000:1.0:1788874017.267588:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840238720 00000100:00100000:1.0:1788874017.267686:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 5 00000100:00100000:1.0:1788874017.267700:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+16:15604:x1875769840238720:12345-192.168.202.20@tcp:35:bash.0 00000001:00080000:1.0:1788874017.268042:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:1.0:1788874017.268299:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+18:15604:x1875769840238720:12345-192.168.202.20@tcp:35:bash.0 Request processed in 600us (976us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788874017.268308:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 5 00000020:00080000:1.0:1788874017.268313:0:17159:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788874017.327132:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788874017.363097:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.363259:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840238976 00000100:00100000:3.0:1788874017.363292:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840238976 00000100:00100000:3.0:1788874017.363376:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 39 00000100:00100000:3.0:1788874017.363398:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+18:15614:x1875769840238976:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:3.0:1788874017.363430:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874017.363463:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b0d expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788874017.363614:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788874017.363771:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b0d expref: 20 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.363791:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d33410df200) 00010000:00010000:3.0:1788874017.363795:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788874017.363801:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b0d expref: 20 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.363820:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f443600, rc 0) 00000100:00100000:3.0:1788874017.363900:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+19:15614:x1875769840238976:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 512us (819us total) trans 8589934603 rc 301/301 00000100:00100000:3.0:1788874017.363907:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 39 00000100:00100000:3.0:1788874017.368061:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.368182:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840239232 00000100:00100000:1.0:1788874017.368197:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840239232 00000100:00100000:1.0:1788874017.368327:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:1.0:1788874017.368340:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+19:15614:x1875769840239232:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:1.0:1788874017.368674:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+20:15614:x1875769840239232:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 336us (627us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788874017.368705:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 6 00000100:00100000:0.0:1788874017.399414:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874017.399568:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840239488 00000100:00100000:2.0:1788874017.399583:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840239488 00000100:00100000:2.0:1788874017.399728:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:2.0:1788874017.399741:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+20:15617:x1875769840239488:12345-192.168.202.20@tcp:101:lfs.0 00010000:00010000:2.0:1788874017.399773:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874017.399820:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9ce10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b14 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.399970:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9ce17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.399989:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9ce17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.400005:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9ce17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788874017.400018:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788874017.400161:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9ce10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b14 expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.400187:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9ce17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b14 expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.400197:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:2.0:1788874017.400411:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788874017.400440:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653400, rc 0) 00000100:00100000:2.0:1788874017.400542:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+22:15617:x1875769840239488:12345-192.168.202.20@tcp:101:lfs.0 Request processed in 804us (1143us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788874017.400553:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 40 00000100:00100000:0.0:1788874017.403099:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874017.403167:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.403196:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840239616 00000100:00100000:3.0:1788874017.403230:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840239616 00000100:00100000:1.0:1788874017.403284:0:19491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840239744 00000100:00100000:1.0:1788874017.403289:0:19491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840239744 00000100:00100000:3.0:1788874017.403307:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:3.0:1788874017.403318:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+23:15617:x1875769840239616:12345-192.168.202.20@tcp:54:lfs.0 00010000:00010000:3.0:1788874017.403417:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.403430:0:19491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:1.0:1788874017.403439:0:19491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+23:2401:x1875769840239744:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788874017.403452:0:19491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874017.403464:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403480:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.403526:0:19491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9ce17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b14 expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403542:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403550:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403558:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.403559:0:19491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:3.0:1788874017.403565:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874017.403566:0:19491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788874017.403572:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403581:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403589:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:3.0:1788874017.403593:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788874017.403597:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.403603:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.403679:0:19491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+22:2401:x1875769840239744:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 240us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.403688:0:19491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:3.0:1788874017.403849:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+21:15617:x1875769840239616:12345-192.168.202.20@tcp:54:lfs.0 Request processed in 531us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874017.403863:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 41 00000100:00100000:3.0:1788874017.405992:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.406049:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840240000 00000100:00100000:1.0:1788874017.406064:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840240000 00000100:00100000:1.0:1788874017.406191:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:1.0:1788874017.406233:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+21:15617:x1875769840240000:12345-192.168.202.20@tcp:35:lfs.0 00000100:00100000:1.0:1788874017.406526:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+22:15617:x1875769840240000:12345-192.168.202.20@tcp:35:lfs.0 Request processed in 324us (544us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788874017.406535:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 7 00000100:00100000:0.0:1788874017.628596:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.628698:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840240256 00000100:00100000:1.0:1788874017.628736:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840240256 00000100:00100000:1.0:1788874017.628799:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:1.0:1788874017.628810:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+22:15648:x1875769840240256:12345-192.168.202.20@tcp:101:cat.0 00010000:00010000:1.0:1788874017.628850:0:20047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.628871:0:20047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b1b expref: -99 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.628988:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9ce33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.629002:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9ce33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.629026:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9ce33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.629040:0:20047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788874017.629181:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b1b expref: 25 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.629249:0:20047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9ce33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b1b expref: 24 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.629260:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.629263:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788874017.629266:0:20047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca600, rc 0) 00000100:00100000:1.0:1788874017.629330:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:15648:x1875769840240256:12345-192.168.202.20@tcp:101:cat.0 Request processed in 522us (743us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788874017.629339:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 42 00000100:00100000:0.0:1788874017.637840:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874017.637891:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874017.638055:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840240512 00000100:00100000:2.0:1788874017.638065:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840240512 00000100:00100000:2.0:1788874017.638124:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:2.0:1788874017.638135:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:15648:x1875769840240512:12345-192.168.202.20@tcp:35:cat.0 00000100:00100000:1.0:1788874017.638168:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840240640 00000100:00100000:1.0:1788874017.638182:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840240640 00000100:00100000:1.0:1788874017.638261:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:1.0:1788874017.638284:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+25:2398:x1875769840240640:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788874017.638297:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874017.638322:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca600/0x25c660afb0a9ce33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b1b expref: 25 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.638344:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.638350:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788874017.638399:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:2398:x1875769840240640:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 117us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.638407:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:2.0:1788874017.639044:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:15648:x1875769840240512:12345-192.168.202.20@tcp:35:cat.0 Request processed in 788us (1093us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788874017.639054:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 8 00000100:00100000:0.0:1788874017.697100:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874017.697272:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840240896 00000100:00100000:2.0:1788874017.697295:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840240896 00000100:00100000:2.0:1788874017.697545:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:2.0:1788874017.697558:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:15654:x1875769840240896:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:2.0:1788874017.697794:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874017.697818:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9ce41 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b22 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.697931:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.697945:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 25 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.697953:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 25 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.697978:0:17156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.698014:0:17156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 25 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.698027:0:17156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 25 pid: 20047 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874017.698042:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1875769859192704:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788874017.698183:0:17156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 25 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874017.698193:0:17156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 25 pid: 17156 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874017.698223:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1875769859192832:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788874017.698254:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a8513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874017.701021:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1875769859192832:192.168.202.20@tcp:104: 00000100:00100000:0.0:1788874017.702188:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.702694:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840241024 00000100:00100000:3.0:1788874017.702713:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840241024 00010000:00010000:3.0:1788874017.702758:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 26 pid: 17156 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874017.702863:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:3.0:1788874017.702873:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+26:2400:x1875769840241024:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788874017.702888:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874017.702895:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 26 pid: 17156 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.702906:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 26 pid: 17156 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.702929:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecaa00/0x25c660afb0a9cde6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9aff expref: 26 pid: 17156 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.702946:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:3.0:1788874017.702951:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.702961:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.702968:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874017.703079:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+25:2400:x1875769840241024:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 207us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874017.703087:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:2.0:1788874017.704179:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.704273:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840241152 00000100:00100000:1.0:1788874017.704279:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840241152 00010000:00010000:1.0:1788874017.704321:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 25 pid: 20047 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.704357:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 18 00000100:00100000:1.0:1788874017.704365:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a6e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+25:2401:x1875769840241152:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788874017.704376:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874017.704382:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 25 pid: 20047 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704394:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 25 pid: 20047 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704411:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.704416:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704435:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704442:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704462:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788874017.704501:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a6e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+25:2401:x1875769840241152:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 137us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.704509:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 18 00010000:00010000:1.0:1788874017.704575:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9cdfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b06 expref: 24 pid: 20047 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874017.704589:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1875769859192704:192.168.202.20@tcp:104: 00010000:00010000:1.0:1788874017.704610:0:17156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704620:0:17156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704625:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874017.704642:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788874017.704805:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9ce41 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b22 expref: 25 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704821:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652a00/0x25c660afb0a9ce48 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b22 expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.704840:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.704843:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788874017.704846:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652a00, rc 0) 00000100:00100000:1.0:1788874017.704871:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:15654:x1875769840240896:12345-192.168.202.20@tcp:101:dd.0 Request processed in 7317us (7787us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1788874017.704878:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 43 00000100:00100000:2.0:1788874017.709988:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.710069:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840241280 00000100:00100000:1.0:1788874017.710078:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840241280 00000100:00100000:1.0:1788874017.710137:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:1.0:1788874017.710147:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+24:15654:x1875769840241280:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:1.0:1788874017.710171:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.710192:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce56 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b29 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.710264:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.710274:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.710290:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.710395:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 26 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.710412:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 25 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.710428:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.710431:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788874017.710435:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475ecba00, rc 0) 00000100:00100000:1.0:1788874017.710488:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+25:15654:x1875769840241280:12345-192.168.202.20@tcp:101:dd.0 Request processed in 342us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.710495:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 44 00000100:00100000:0.0:1788874017.718412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.718571:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840241536 00000100:00100000:3.0:1788874017.718590:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840241536 00000100:00100000:3.0:1788874017.718654:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 45 00000100:00100000:3.0:1788874017.718664:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+25:15654:x1875769840241536:12345-192.168.202.20@tcp:36:dd.0 00010000:00010000:3.0:1788874017.718918:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.718938:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.718949:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788874017.718993:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:3.0:1788874017.719016:0:17155:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c08afcc9 reply state 00000000e7d4624b transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.719029:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.719036:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:3.0:1788874017.719039:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788874017.719044:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788874017.719146:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+28:15654:x1875769840241536:12345-192.168.202.20@tcp:36:dd.0 Request processed in 483us (762us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788874017.719154:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 45 00000020:00080000:3.0:1788874017.719159:0:17155:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788874017.722904:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.722999:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840241664 00000100:00100000:1.0:1788874017.723010:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840241664 00000100:00100000:1.0:1788874017.723073:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:1.0:1788874017.723083:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+28:15654:x1875769840241664:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:1.0:1788874017.723107:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.723128:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce6b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b30 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.723185:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce6b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b30 expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.723249:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce6b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b30 expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.723279:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.723289:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788874017.723293:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca200, rc 0) 00000100:00100000:1.0:1788874017.723350:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15654:x1875769840241664:12345-192.168.202.20@tcp:101:dd.0 Request processed in 268us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.723358:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 46 00000100:00100000:2.0:1788874017.735651:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.735811:0:19491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840241920 00000100:00100000:1.0:1788874017.735823:0:19491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840241920 00000100:00100000:1.0:1788874017.735898:0:19491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:1.0:1788874017.735908:0:19491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15654:x1875769840241920:12345-192.168.202.20@tcp:103:dd.0 00010000:00010000:1.0:1788874017.735926:0:19491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788874017.735955:0:19491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce6b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b30 expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.735975:0:19491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.735979:0:19491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788874017.736045:0:19491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+28:15654:x1875769840241920:12345-192.168.202.20@tcp:103:dd.0 Request processed in 139us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.736052:0:19491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 2 00000100:00100000:0.0:1788874017.740509:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874017.740582:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840242048 00000100:00100000:3.0:1788874017.740595:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840242048 00000100:00100000:3.0:1788874017.740660:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:3.0:1788874017.740670:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+28:15654:x1875769840242048:12345-192.168.202.20@tcp:58:dd.0 00010000:00010000:3.0:1788874017.740962:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.740980:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874017.740992:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788874017.742868:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788874017.743175:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788874017.743393:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788874017.743512:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+28:15654:x1875769840242048:12345-192.168.202.20@tcp:58:dd.0 Request processed in 2836us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874017.743523:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 47 00000100:00100000:0.0:1788874017.747428:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874017.755048:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840242176 00000100:00100000:1.0:1788874017.755075:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840242176 00000100:00100000:1.0:1788874017.755342:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 48 00000100:00100000:1.0:1788874017.755358:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+28:15654:x1875769840242176:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:1.0:1788874017.755460:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874017.755495:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b37 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.755575:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.755591:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.755618:0:17157:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.755657:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.755674:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874017.755678:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788874017.755682:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874017.755690:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca200, rc 0) 00000100:00100000:1.0:1788874017.755853:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15654:x1875769840242176:12345-192.168.202.20@tcp:101:dd.0 Request processed in 499us (8442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874017.755861:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 48 00010000:00010000:2.0:1788874017.903863:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874018.031894:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859192960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788874018.032000:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874018.032187:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859192960 00000100:00100000:3.0:1788874018.032200:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859192960 00000100:00100000:3.0:1788874018.032307:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788874018.032320:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859192960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788874018.032348:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788874018.032714:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874018.032800:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859192960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 482us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.032808:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788874018.037415:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859192960:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788874018.351343:0:17191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788874018.351358:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788874018.351394:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788874018.351404:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788874018.351599:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17191:1875769859193088:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788874018.351884:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451739a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874018.355518:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17191:1875769859193088:192.168.202.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788874018.361568:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874018.361967:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840242304 00000100:00100000:1.0:1788874018.361981:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840242304 00000100:00100000:1.0:1788874018.362085:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 49 00000100:00100000:1.0:1788874018.362101:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15655:x1875769840242304:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788874018.362148:0:17156:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788874018.362368:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15655:x1875769840242304:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 271us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874018.362403:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 49 00000100:00080000:2.0:1788874018.362533:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788874018.371759:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874018.371987:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840242432 00000100:00100000:1.0:1788874018.372001:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840242432 00000100:00100000:1.0:1788874018.372083:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:1.0:1788874018.372096:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15655:x1875769840242432:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788874018.372406:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372429:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372446:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372717:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372744:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372759:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372794:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372803:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372809:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874018.372882:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788874018.372886:0:17157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788874018.372901:0:17157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372912:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372918:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372926:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372933:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecbc00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874018.372937:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372945:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372958:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d33410df100) 00010000:00010000:1.0:1788874018.372961:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874018.372966:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372972:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecbc00/0x25c660afb0a9ce80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.372989:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373016:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373022:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373026:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874018.373029:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373035:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373043:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d33410df400) 00010000:00010000:1.0:1788874018.373045:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874018.373048:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373053:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce87 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373068:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373073:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373078:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373083:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874018.373091:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373098:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373105:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874018.373108:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788874018.373111:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.373117:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874018.373299:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15655:x1875769840242432:12345-192.168.202.20@tcp:34:lhsmtool_posix.0 Request processed in 1199us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874018.373312:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 50 00000100:00100000:0.0:1788874018.386477:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874018.386842:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840242688 00000100:00100000:1.0:1788874018.386857:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840242688 00000100:00100000:1.0:1788874018.386934:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:1.0:1788874018.386945:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+29:15655:x1875769840242688:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788874018.386973:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874018.387117:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b3e expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387295:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387315:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387366:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788874018.387382:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788874018.387629:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387637:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387644:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387650:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874018.387656:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387664:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387680:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:1.0:1788874018.387683:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788874018.387689:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387696:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ce9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387764:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce95 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b3e expref: 31 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387790:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d33410df100) 00010000:00010000:1.0:1788874018.387792:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788874018.387797:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9ce95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b3e expref: 31 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.387808:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca800, rc 0) 00000100:00100000:1.0:1788874018.387901:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+30:15655:x1875769840242688:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 957us (1439us total) trans 8589934612 rc 301/301 00000100:00100000:1.0:1788874018.387910:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 51 00000100:00100000:0.0:1788874018.390843:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.391110:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840242816 00000100:00100000:2.0:1788874018.391125:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840242816 00000100:00100000:2.0:1788874018.391196:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:2.0:1788874018.391230:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+30:15655:x1875769840242816:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788874018.391275:0:20047:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788874018.391440:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+30:15655:x1875769840242816:12345-192.168.202.20@tcp:53:lhsmtool_posix.0 Request processed in 233us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.391448:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:0.0:1788874018.397405:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.397546:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840243072 00000100:00100000:3.0:1788874018.397560:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840243072 00000100:00100000:3.0:1788874018.397637:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:3.0:1788874018.397666:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+30:15655:x1875769840243072:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788874018.397709:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874018.397741:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ceaa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b45 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788874018.401437:0:17155:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1788874018.401461:0:17155:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788874018.401515:0:17155:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788874018.401809:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9ceb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.401831:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.401847:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.401945:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443c00/0x25c660afb0a9ceaa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b45 expref: 33 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.401970:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9ceb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b45 expref: 32 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.401980:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3443403300) 00010000:00010000:2.0:1788874018.402147:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788874018.402153:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652000, rc 0) 00000100:00100000:2.0:1788874018.402868:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+32:15655:x1875769840243072:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 5199us (5471us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788874018.402880:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:0.0:1788874018.413561:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.413693:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840243328 00000100:00100000:2.0:1788874018.413719:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840243328 00000100:00100000:2.0:1788874018.413808:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:2.0:1788874018.413821:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+32:15655:x1875769840243328:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788874018.413897:0:20047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874018.413934:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9ceb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b45 expref: 32 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.413960:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3443403300) 00010000:00010000:2.0:1788874018.413975:0:20047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788874018.414020:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414038:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414050:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414072:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414080:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414112:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414180:0:20047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414188:0:20047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414196:0:20047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414271:0:20047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653400 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.414278:0:20047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414287:0:20047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414297:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:2.0:1788874018.414299:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874018.414304:0:20047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414311:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cebf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414322:0:20047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414329:0:20047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414346:0:20047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414352:0:20047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.414356:0:20047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414363:0:20047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414372:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x68c9c0d7 (ffff9d3443403e00) 00010000:00010000:2.0:1788874018.414374:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874018.414378:0:20047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.414384:0:20047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cec6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x68c9c0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.414486:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+31:15655:x1875769840243328:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 666us (940us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788874018.414494:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:0.0:1788874018.423185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874018.423366:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840243456 00000100:00100000:1.0:1788874018.423380:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840243456 00000100:00100000:1.0:1788874018.423461:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:1.0:1788874018.423472:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+31:15655:x1875769840243456:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788874018.423510:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874018.423547:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9cecd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b4c expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.423597:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ced4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.423615:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ced4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.423630:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ced4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.423799:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca800/0x25c660afb0a9cecd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b4c expref: 33 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.423821:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca400/0x25c660afb0a9ced4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b4c expref: 32 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.423828:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:1.0:1788874018.423831:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788874018.423834:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3475eca400, rc 0) 00000100:00100000:1.0:1788874018.423897:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+32:15655:x1875769840243456:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 428us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874018.423903:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 55 00000100:00100000:0.0:1788874018.438070:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.438247:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840243712 00000100:00100000:2.0:1788874018.438265:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840243712 00000100:00100000:2.0:1788874018.438357:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:2.0:1788874018.438370:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+32:15655:x1875769840243712:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788874018.438508:0:20047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.438530:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.438564:0:20047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788874018.440280:0:20047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788874018.440310:0:20047:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 555386104914ns, next at 556386097424ns, rc = 0 00000004:00010000:2.0:1788874018.440422:0:20047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f98f5901 reply state 00000000cd7418a7 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.440447:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.440458:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.440461:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788874018.440467:0:20047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788874018.440628:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+34:15655:x1875769840243712:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 2256us (2567us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788874018.440638:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 56 00000100:00100000:0.0:1788874018.443610:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.443656:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.443694:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.443732:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.443787:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244096 00000100:00100000:0.0:1788874018.443799:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244096 00000100:00100000:0.0:1788874018.443866:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244608 00000100:00100000:0.0:1788874018.443869:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244608 00000100:00100000:0.0:1788874018.443891:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:0.0:1788874018.443901:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2399:x1875769840244096:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874018.443990:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2399:x1875769840244096:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.443998:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 14 00000100:00100000:0.0:1788874018.444019:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00100000:0.0:1788874018.444025:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6ca012d0-0acd-4ca6-971d-710455c35699+5:2399:x1875769840244608:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874018.444047:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6ca012d0-0acd-4ca6-971d-710455c35699+5:2399:x1875769840244608:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 23us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.444053:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 15 00000100:00080000:0.0:1788874018.444072:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788874018.444101:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.444160:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.444313:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244224 00000100:00100000:3.0:1788874018.444319:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244224 00000100:00100000:3.0:1788874018.444358:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00100000:3.0:1788874018.444366:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2399:x1875769840244224:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788874018.444410:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2399:x1875769840244224:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 45us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.444417:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 16 00000100:00080000:3.0:1788874018.444435:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874018.444451:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244352 00000100:00100000:3.0:1788874018.444455:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244352 00000100:00100000:3.0:1788874018.444490:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840243968 00000100:00100000:3.0:1788874018.444493:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840243968 00000100:00080000:3.0:1788874018.444510:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788874018.444553:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:3.0:1788874018.444560:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+12:2399:x1875769840244352:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788874018.444599:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+12:2399:x1875769840244352:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 39us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.444605:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 52 00000100:00100000:3.0:1788874018.444619:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:3.0:1788874018.444625:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2399:x1875769840243968:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:3.0:1788874018.444650:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2399:x1875769840243968:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 25us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.444664:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 53 00000100:00100000:1.0:1788874018.444932:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840243840 00000100:00100000:1.0:1788874018.444938:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840243840 00000100:00100000:1.0:1788874018.444985:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 163 00000100:00100000:1.0:1788874018.444993:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+13:2399:x1875769840243840:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:1.0:1788874018.445020:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24a1c553-66f3-4674-b9cc-0bbc78015451+13:2399:x1875769840243840:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 29us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874018.445027:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 163 00000100:00100000:3.0:1788874018.449180:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.449416:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.449456:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.449514:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244736 00000100:00100000:0.0:1788874018.449526:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244736 00000100:00100000:0.0:1788874018.449622:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00100000:0.0:1788874018.449634:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6ca012d0-0acd-4ca6-971d-710455c35699+5:2399:x1875769840244736:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:0.0:1788874018.449736:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6ca012d0-0acd-4ca6-971d-710455c35699+5:2399:x1875769840244736:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.449745:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 17 00000100:00080000:2.0:1788874018.450061:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788874018.451955:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244480 00000100:00100000:1.0:1788874018.451973:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244480 00000100:00100000:1.0:1788874018.452042:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244864 00000100:00100000:1.0:1788874018.452046:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244864 00000100:00100000:1.0:1788874018.452092:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:1.0:1788874018.452105:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+5:2399:x1875769840244480:12345-192.168.202.20@tcp:400:kworker.0 00000100:00100000:2.0:1788874018.452291:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:2.0:1788874018.452303:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+34:15655:x1875769840244864:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788874018.452323:0:20047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874018.452351:0:20047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b53 expref: -99 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.452438:0:20047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 35 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.452457:0:20047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 35 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.452513:0:20047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.452517:0:20047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788874018.452523:0:20047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441653400, rc 0) 00000100:00100000:1.0:1788874018.452758:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ca012d0-0acd-4ca6-971d-710455c35699+5:2399:x1875769840244480:12345-192.168.202.20@tcp:400:kworker.0 Request processed in 654us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874018.452767:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 54 00000100:00100000:2.0:1788874018.453018:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+35:15655:x1875769840244864:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 718us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.453026:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 57 00000100:00100000:2.0:1788874018.456102:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.456181:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840244992 00000100:00100000:3.0:1788874018.456226:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840244992 00000100:00100000:3.0:1788874018.456307:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:3.0:1788874018.456320:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2401:x1875769840244992:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788874018.457154:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2401:x1875769840244992:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 830us (1061us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788874018.457166:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:2.0:1788874018.460036:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.460284:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840245248 00000100:00100000:0.0:1788874018.460299:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840245248 00000100:00100000:0.0:1788874018.460555:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:0.0:1788874018.460568:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+35:15655:x1875769840245248:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788874018.460886:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+36:15655:x1875769840245248:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 320us (864us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788874018.460895:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 9 00000100:00100000:1.0:1788874018.463092:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.463187:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840245504 00000100:00100000:3.0:1788874018.463239:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840245504 00000100:00100000:3.0:1788874018.463298:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:3.0:1788874018.463310:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+36:15655:x1875769840245504:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788874018.464033:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+36:15655:x1875769840245504:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 722us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.464042:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 58 00000100:00100000:1.0:1788874018.466998:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.467596:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840245632 00000100:00100000:2.0:1788874018.467610:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840245632 00000100:00100000:2.0:1788874018.467736:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:2.0:1788874018.467749:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+36:15655:x1875769840245632:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788874018.467777:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874018.467810:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cee9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b5a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.467927:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cef0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.467945:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cef0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.467959:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cef0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788874018.468014:0:17157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788874018.468036:0:17157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cef0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.468069:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cee9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b5a expref: 38 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.468090:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cef0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b5a expref: 37 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.468099:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.468102:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788874018.468107:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3441652800, rc 0) 00000100:00100000:2.0:1788874018.468175:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+37:15655:x1875769840245632:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 429us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.468182:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 59 00000100:00100000:1.0:1788874018.471833:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.472099:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840245760 00000100:00100000:3.0:1788874018.472113:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840245760 00000100:00100000:3.0:1788874018.472283:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:3.0:1788874018.472298:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2398:x1875769840245760:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788874018.472324:0:19195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874018.472355:0:19195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b61 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788874018.472554:0:19195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa00d23, blocks: 0x0 00010000:00010000:3.0:1788874018.472587:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788874018.472593:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874018.472605:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 7 pid: 19195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.472631:0:19195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 7 pid: 19195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.472648:0:19195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442200, rc 0) 00000100:00100000:3.0:1788874018.472842:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2398:x1875769840245760:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 547us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.472850:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:1.0:1788874018.476070:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.476181:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246016 00000100:00100000:3.0:1788874018.476307:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246016 00000100:00100000:3.0:1788874018.476470:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:3.0:1788874018.476554:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+37:15655:x1875769840246016:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788874018.476747:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+37:15655:x1875769840246016:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 198us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.476755:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 60 00000100:00100000:1.0:1788874018.481167:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.481392:0:20047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246144 00000100:00100000:0.0:1788874018.481408:0:20047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246144 00000100:00100000:0.0:1788874018.481491:0:20047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 61 00000100:00100000:0.0:1788874018.481505:0:20047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+37:15655:x1875769840246144:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788874018.484122:0:17135:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:3.0:1788874018.484148:0:17135:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788874018.484247:0:17135:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788874018.484457:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788874018.484485:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859193216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788874018.484577:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874018.484638:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859193216 00000100:00100000:0.0:1788874018.484647:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859193216 00000100:00100000:0.0:1788874018.484729:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788874018.484740:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859193216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788874018.484905:0:18662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788874018.484909:0:18662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788874018.484912:0:18662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788874018.484914:0:18662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788874019 -> 1788874019 00002000:00010000:0.0:1788874018.484917:0:18662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788874018.484966:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1875769859193216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (388us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788874018.484975:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1788874018.485033:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3475d91f80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788874018.485039:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859193216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788874018.485184:0:20047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+19:15655:x1875769840246144:12345-192.168.202.20@tcp:44:lhsmtool_posix.0 Request processed in 3679us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.485194:0:20047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 61 00010000:00010000:1.0:1788874018.485610:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.485623:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.485631:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.485638:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434df600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:1.0:1788874018.485643:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.485652:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.485670:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:1.0:1788874018.485674:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788874018.485679:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.485686:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434df600/0x25c660afb0a9cd84 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488454:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488478:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488488:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488496:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434de800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.488502:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488512:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488537:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d33410dfb00) 00010000:00010000:2.0:1788874018.488564:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874018.488573:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488581:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434de800/0x25c660afb0a9cd30 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488617:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488624:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488631:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488636:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d33434dee00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.488639:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488646:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488656:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d33410dfd00) 00010000:00010000:2.0:1788874018.488658:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874018.488661:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488667:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d33434dee00/0x25c660afb0a9cd37 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488684:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488712:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488718:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488723:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecb800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.488726:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488732:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488741:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d33410df300) 00010000:00010000:2.0:1788874018.488743:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874018.488747:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488752:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecb800/0x25c660afb0a9cddf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488771:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488777:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488783:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488789:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.488798:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488804:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488814:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:2.0:1788874018.488817:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788874018.488820:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488826:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443600/0x25c660afb0a9ce64 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488839:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488847:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488853:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488858:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.488861:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488867:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488877:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.488879:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788874018.488891:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.488898:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cedb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788874018.488927:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788874018.489616:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.489708:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246272 00000100:00100000:0.0:1788874018.489722:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246272 00000100:00100000:0.0:1788874018.489795:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:0.0:1788874018.489808:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2400:x1875769840246272:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788874018.489965:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2400:x1875769840246272:12345-192.168.202.20@tcp:16:lhsmtool_posix.0 Request processed in 159us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.489974:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 23 00000100:00100000:1.0:1788874018.493961:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.494051:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246528 00000100:00100000:2.0:1788874018.494066:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246528 00000100:00100000:2.0:1788874018.494149:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00100000:2.0:1788874018.494162:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+15:15655:x1875769840246528:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788874018.494296:0:17155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874018.494333:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cef0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b5a expref: 15 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.494360:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.494367:0:17155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788874018.494417:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cefe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.494437:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cefe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.494447:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cefe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788874018.494617:0:17155:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d35675b reply state 00000000e14cd4fc transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cefe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.494632:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652000/0x25c660afb0a9cefe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.494660:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.494663:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788874018.494667:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788874018.494807:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+16:15655:x1875769840246528:12345-192.168.202.20@tcp:36:lhsmtool_posix.0 Request processed in 646us (862us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788874018.494815:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 62 00000100:00100000:1.0:1788874018.497944:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.498111:0:19195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246656 00000100:00100000:3.0:1788874018.498134:0:19195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246656 00000100:00100000:3.0:1788874018.498244:0:19195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:3.0:1788874018.498256:0:19195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:15655:x1875769840246656:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788874018.498281:0:19195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874018.498306:0:19195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b68 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.498348:0:19195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.498357:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874018.498362:0:19195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874018.498368:0:19195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 8 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.498425:0:19195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.498441:0:19195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874018.498458:0:19195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19195:1875769859193344:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788874018.498577:0:19195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874018.502385:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.502579:0:19195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19195:1875769859193344:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788874018.502624:0:19195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 8 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.502672:0:19195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d347f442c00, rc 0) 00000100:00100000:3.0:1788874018.502748:0:19195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+8:15655:x1875769840246656:12345-192.168.202.20@tcp:101:lhsmtool_posix.0 Request processed in 4494us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.502759:0:19195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 24 00000100:00100000:0.0:1788874018.502976:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246784 00000100:00100000:0.0:1788874018.502985:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246784 00010000:00010000:0.0:1788874018.503031:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874018.503076:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:0.0:1788874018.503087:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+8:2400:x1875769840246784:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788874018.503109:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874018.503140:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.503156:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.503199:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c3bfb2b/0x25c660afb0a9cef7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b61 expref: 8 pid: 19195 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.503262:0:17141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874018.503267:0:17141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788874018.503275:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 7 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.503289:0:17141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 7 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.503335:0:17141:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 7 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874018.503353:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17141:1875769859193472:192.168.202.20@tcp:105: 00000100:00100000:0.0:1788874018.503425:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3480d96a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788874018.513312:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17141:1875769859193472:192.168.202.20@tcp:105: 00010000:00010000:0.0:1788874018.513357:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874018.513438:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2400:x1875769840246784:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 10351us (11080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.513451:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 19 00000100:00100000:1.0:1788874018.518932:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.519258:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840246912 00000100:00100000:0.0:1788874018.519271:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840246912 00000100:00100000:0.0:1788874018.519339:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:0.0:1788874018.519350:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347ab54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2400:x1875769840246912:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788874018.519801:0:19728:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788874018.519825:0:19728:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788874018 00002000:00010000:0.0:1788874018.519828:0:19728:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788874017 00002000:00010000:0.0:1788874018.519830:0:19728:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788874019 -> 1788874018 00002000:00010000:0.0:1788874018.519833:0:19728:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788874018.519951:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347ab54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+8:2400:x1875769840246912:12345-192.168.202.20@tcp:2:lhsmtool_posix.0 Request processed in 601us (1034us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788874018.519960:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 25 00000100:00100000:1.0:1788874018.533186:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.533416:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247040 00000100:00100000:3.0:1788874018.533430:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247040 00000100:00100000:3.0:1788874018.533507:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:3.0:1788874018.533520:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+8:2398:x1875769840247040:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788874018.533581:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.533607:0:18660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 8 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.533619:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788874018.533624:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788874018.533631:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.533675:0:18660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 8 pid: 19195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.533692:0:18660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 8 pid: 19195 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874018.533743:0:18660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18660:1875769859193600:192.168.202.20@tcp:104: 00000100:00100000:3.0:1788874018.533852:0:18660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3451830c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874018.537824:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.537941:0:19491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247168 00000100:00100000:2.0:1788874018.537954:0:19491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247168 00010000:00010000:2.0:1788874018.538007:0:19491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 9 pid: 19195 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.538062:0:19491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 20 00000100:00100000:2.0:1788874018.538074:0:19491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:2400:x1875769840247168:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788874018.538099:0:19491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874018.538128:0:19491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 9 pid: 19195 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.538146:0:19491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 9 pid: 19195 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.538178:0:19491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788874018.538183:0:19491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788874018.538201:0:19491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.538258:0:19491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.538304:0:19491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874018.538367:0:19491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+9:2400:x1875769840247168:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 295us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.538375:0:19491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 20 00010000:00010000:3.0:1788874018.539147:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da3c32d8/0x25c660afb0a9cf05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b68 expref: 8 pid: 19195 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874018.539169:0:18660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18660:1875769859193600:192.168.202.20@tcp:104: 00010000:00010000:3.0:1788874018.539581:0:18660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539671:0:18660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539682:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539726:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539736:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539746:0:18660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539753:0:18660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:2.0:1788874018.539759:0:18660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539769:0:18660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539804:0:18660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.539813:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383b4c81/0x25c660afb0a9cf0c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.539912:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+7:2398:x1875769840247040:12345-192.168.202.20@tcp:1:lhsmtool_posix.0 Request processed in 6393us (6739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.539923:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 26 00000100:00100000:1.0:1788874018.543718:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.543820:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247424 00000100:00100000:2.0:1788874018.543834:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247424 00000100:00100000:2.0:1788874018.543908:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 63 00000100:00100000:2.0:1788874018.543922:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+16:15655:x1875769840247424:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788874018.544036:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.544059:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 16 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.544071:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.544115:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 16 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.544131:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 16 pid: 17157 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.544163:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859193728:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788874018.544761:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a8510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788874018.551828:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.555618:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859193728:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788874018.555660:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874018.557613:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247552 00000100:00100000:3.0:1788874018.557635:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247552 00010000:00010000:2.0:1788874018.563719:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 17 pid: 17157 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.563796:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 21 00000100:00100000:2.0:1788874018.563812:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+17:2400:x1875769840247552:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788874018.563834:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874018.563843:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 17 pid: 17157 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.563859:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 17 pid: 17157 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.563889:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475ecba00/0x25c660afb0a9ce5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b29 expref: 17 pid: 17157 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.563912:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:2.0:1788874018.563919:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 16 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.563956:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.563966:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.563976:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.565635:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874018.565755:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+16:2400:x1875769840247552:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 1939us (13933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.565770:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 21 00010000:00010000:3.0:1788874018.569576:0:17157:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.569602:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.576524:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.576555:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 16 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.576566:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.576607:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 16 pid: 20047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.576747:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 16 pid: 20047 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.576766:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859193856:192.168.202.20@tcp:104: 00000100:00100000:2.0:1788874018.578771:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d347a851240 going to sleep for 11 seconds 00000100:00100000:1.0:1788874018.591405:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:2.0:1788874018.591436:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859193856:192.168.202.20@tcp:104: 00010000:00010000:2.0:1788874018.591471:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874018.591571:0:19491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247680 00000100:00100000:3.0:1788874018.591626:0:19491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247680 00010000:00010000:3.0:1788874018.591680:0:19491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 17 pid: 20047 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874018.591748:0:19491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 22 00000100:00100000:3.0:1788874018.591759:0:19491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+17:2400:x1875769840247680:12345-192.168.202.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788874018.591778:0:19491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874018.591805:0:19491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 17 pid: 20047 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.591821:0:19491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 17 pid: 20047 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.591851:0:19491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653400/0x25c660afb0a9cee2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b53 expref: 17 pid: 20047 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.591871:0:19491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:3.0:1788874018.591877:0:19491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.591890:0:19491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.591899:0:19491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.591935:0:19491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874018.592004:0:19491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+16:2400:x1875769840247680:12345-192.168.202.20@tcp:103:ldlm_bl.0 Request processed in 246us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.592012:0:19491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 22 00010000:00010000:2.0:1788874018.592516:0:17157:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.592531:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788874018.594110:0:17157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788874018.595475:0:17157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:2.0:1788874018.595526:0:17157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788874018.598482:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17157:1875769859193984:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788874018.598572:0:17157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874018.598667:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859193984 00000100:00100000:3.0:1788874018.598686:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859193984 00000100:00100000:3.0:1788874018.598786:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788874018.598799:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17157:x1875769859193984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788874018.598956:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17157:x1875769859193984:12345-0@lo:1000:mdt00_002.0 Request processed in 159us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874018.598986:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788874018.600116:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450fccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874018.600763:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17157:1875769859193984:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788874018.602844:0:17157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1788874018.604671:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17157:1875769859194112:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788874018.604760:0:17157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874018.604800:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450fccd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788874018.604840:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859194112 00000100:00100000:3.0:1788874018.604858:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859194112 00000100:00100000:3.0:1788874018.604930:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788874018.604941:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17157:x1875769859194112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788874018.605202:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17157:x1875769859194112:12345-0@lo:1000:mdt00_002.0 Request processed in 261us (440us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788874018.605257:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788874018.606155:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17157:1875769859194112:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788874018.606714:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606727:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606755:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606762:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441653600 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.606766:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606774:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606791:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:2.0:1788874018.606794:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788874018.606799:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606805:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441653600/0x25c660afb0a9cf1a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606855:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606862:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606868:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606873:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443a00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:2.0:1788874018.606876:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606892:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606901:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:2.0:1788874018.606904:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788874018.606919:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 19 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606931:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 19 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.606940:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 19 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874018.607757:0:17157:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3475eca200/0x25c660afb0a9ce79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b37 expref: 19 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.607776:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859194240:192.168.202.20@tcp:105: 00000100:00100000:3.0:1788874018.611113:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3450fcc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788874018.614391:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:3.0:1788874018.614487:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d334359f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17157:1875769859194240:192.168.202.20@tcp:105: 00010000:00010000:3.0:1788874018.614529:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614542:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443a00/0x25c660afb0a9ce72 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614590:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614610:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.614617:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247808 00010000:00010000:3.0:1788874018.614625:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.614643:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247808 00010000:00010000:3.0:1788874018.614646:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614656:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614680:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614704:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f442c00 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788874018.614710:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.614721:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 10 00010000:00010000:3.0:1788874018.614727:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.614740:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347a445c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+20:15654:x1875769840247808:12345-192.168.202.20@tcp:49:dd.0 00010000:00010000:3.0:1788874018.614749:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:3.0:1788874018.614755:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788874018.614760:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614768:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f442c00/0x25c660afb0a9cf21 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614781:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614789:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614797:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614802:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3441652800 already unused, calling callback (ffffffffc1a6d4f0) 00010000:00010000:3.0:1788874018.614806:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614825:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614836:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:3.0:1788874018.614839:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788874018.614843:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.614849:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3441652800/0x25c660afb0a9cf13 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874018.614910:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347a445c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+20:15654:x1875769840247808:12345-192.168.202.20@tcp:49:dd.0 Request processed in 176us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874018.614919:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 10 00000100:00100000:3.0:1788874018.615041:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+19:15655:x1875769840247424:12345-192.168.202.20@tcp:57:lhsmtool_posix.0 Request processed in 71119us (71346us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788874018.615053:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 63 00000020:00080000:3.0:1788874018.615058:0:17157:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788874018.615112:0:17191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788874018.615118:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788874018.615153:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788874018.615161:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788874018.621606:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.621671:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.621734:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840247936 00000100:00100000:0.0:1788874018.621751:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840247936 00000100:00100000:0.0:1788874018.621847:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:0.0:1788874018.621859:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+19:15654:x1875769840247936:12345-192.168.202.20@tcp:101:dd.0 00010000:00010000:0.0:1788874018.621887:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874018.621915:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25000/0x25c660afb0a9cf28 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad99b647837a9b6f expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.621963:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24000/0x25c660afb0a9cf2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.621981:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24000/0x25c660afb0a9cf2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.621995:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24000/0x25c660afb0a9cf2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.622160:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e25000/0x25c660afb0a9cf28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b6f expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.622196:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3341e24000/0x25c660afb0a9cf2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.20@tcp remote: 0xad99b647837a9b6f expref: 20 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.622230:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d33410df500) 00010000:00010000:0.0:1788874018.622234:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788874018.622239:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3341e24000, rc 0) 00000100:00100000:0.0:1788874018.622315:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+20:15654:x1875769840247936:12345-192.168.202.20@tcp:101:dd.0 Request processed in 459us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874018.622323:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 64 00000100:00100000:3.0:1788874018.622572:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840248192 00000100:00100000:3.0:1788874018.622579:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840248192 00000100:00100000:3.0:1788874018.622626:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 11 00000100:00100000:3.0:1788874018.622634:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+20:15655:x1875769840248192:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788874018.622969:0:17158:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788874018.623017:0:17158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:3.0:1788874018.623049:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623066:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623078:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623104:0:17158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623111:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623118:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623141:0:17158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788874018.623256:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+22:15655:x1875769840248192:12345-192.168.202.20@tcp:35:lhsmtool_posix.0 Request processed in 621us (1582us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788874018.623264:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 11 00000020:00080000:3.0:1788874018.623268:0:17158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788874018.623483:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874018.623492:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623500:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d347f443e00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:3.0:1788874018.623505:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623514:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623528:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d33410df400) 00010000:00010000:3.0:1788874018.623531:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788874018.623537:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623555:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d347f443e00/0x25c660afb0a9cf36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874018.623568:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874018.623570:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874018.623573:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874018.815740:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:0.0:1788874018.815804:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.20@tcp (source: 12345-192.168.202.20@tcp) 00000100:00100000:1.0:1788874018.816016:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840248448 00000100:00100000:1.0:1788874018.816031:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840248448 00000100:00100000:1.0:1788874018.816119:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769840248320 00000100:00100000:1.0:1788874018.816123:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769840248320 00000100:00100000:1.0:1788874018.816144:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:1.0:1788874018.816157:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+8:2398:x1875769840248448:12345-192.168.202.20@tcp:4:dd.0 00002000:00010000:1.0:1788874018.816509:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa00d22, atime: 0x6aa00d21, ctime: 0x6aa00d22, blocks: 0x0 00010000:00010000:1.0:1788874018.816522:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.816544:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788874018.816550:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874018.816558:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.816580:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788874018.921651:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788874018.921704:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788874018.921933:0:18666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788874018.921938:0:18666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788874018 -> 1788874019 00002000:00010000:1.0:1788874018.921941:0:18666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788874018 -> 1788874019 00002000:00010000:1.0:1788874018.921943:0:18666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788874018.921961:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.921975:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.921984:0:18666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.921992:0:18666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475ecba00 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874018.921997:0:18666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.922006:0:18666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.922025:0:18666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.922033:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a29a38/0x25c660afb0a9cf3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874018.922194:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+6:2398:x1875769840248448:12345-192.168.202.20@tcp:4:dd.0 Request processed in 106033us (106466us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788874018.922249:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 0 00000100:00100000:1.0:1788874018.922282:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:1.0:1788874018.922294:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2398:x1875769840248320:12345-192.168.202.20@tcp:4:dd.0 00002000:00010000:1.0:1788874018.922336:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6aa00d23, atime: 0x6aa00d21, ctime: 0x6aa00d23, blocks: 0x1a68 00010000:00010000:1.0:1788874018.922343:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.922366:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788874018.922372:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788874018.922379:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.922392:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874018.929086:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788874018.988797:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1788874018.989015:0:18666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1788874018.989044:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.989061:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.989072:0:18666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.989100:0:18666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3475eca000 already unused, calling callback (ffffffffc0e3f4f0) 00010000:00010000:1.0:1788874018.989106:0:18666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.989118:0:18666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.989346:0:18666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874018.989357:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18b399f/0x25c660afb0a9cf44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874018.989510:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d9d9f52-cdcd-4512-9323-03ee4f1ee5cb+5:2398:x1875769840248320:12345-192.168.202.20@tcp:4:dd.0 Request processed in 67210us (173695us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788874018.989523:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.20@tcp, seq: 1 00000100:00100000:3.0:1788874019.054592:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788874019.054636:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859194368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788874019.054761:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874019.054867:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859194368 00000100:00100000:3.0:1788874019.054878:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859194368 00000100:00100000:3.0:1788874019.054931:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788874019.054939:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859194368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788874019.054978:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788874019.055023:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875769859194368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874019.055029:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788874019.055076:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1875769859194368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788874019.056098:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788874019.056118:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859194496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788874019.056183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874019.056247:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859194496 00000100:00100000:0.0:1788874019.056255:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859194496 00000100:00100000:0.0:1788874019.056301:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788874019.056309:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859194496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788874019.056344:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788874019.056393:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859194496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874019.056401:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788874019.056453:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3475d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859194496:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788874019.119174:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788874019.950668:0:17909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788874020.525993:0:20334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788874020.974373:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874021.614409:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788874021.614446:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859194624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788874021.614545:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874021.614612:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859194624 00000100:00100000:3.0:1788874021.614622:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859194624 00000100:00100000:3.0:1788874021.614703:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788874021.614724:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859194624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788874021.614762:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788874021.614815:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859194624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874021.614823:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788874021.614847:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874021.614881:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788874021.614887:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3475d91f80, transno 8589934596 00000004:00080000:3.0:1788874021.614899:0:3634:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788874021.614932:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859194624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788874021.615258:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788874021.615269:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859194752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788874021.615303:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874021.615334:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859194752 00000100:00100000:3.0:1788874021.615338:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859194752 00000100:00100000:3.0:1788874021.615370:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788874021.615377:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859194752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788874021.615391:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788874021.615425:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875769859194752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874021.615431:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788874021.615448:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874021.615468:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1875769859194752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788874021.616794:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859195264:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.616866:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874021.616911:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859195776:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.616941:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874021.616967:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788874021.616974:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859195136:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874021.617021:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859195648:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617043:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874021.617061:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859196160:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617085:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874021.617117:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195264 00000100:00100000:0.0:1788874021.617125:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195264 00000100:00100000:0.0:1788874021.617164:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195776 00000100:00100000:0.0:1788874021.617167:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195776 00000100:00100000:0.0:1788874021.617190:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195648 00000100:00100000:0.0:1788874021.617193:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195648 00000100:00100000:0.0:1788874021.617229:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859196160 00000100:00100000:0.0:1788874021.617233:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859196160 00000100:00100000:0.0:1788874021.617251:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788874021.617259:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859195264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617309:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875769859195264:12345-0@lo:400:kworker.0 Request processed in 50us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874021.617318:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788874021.617336:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788874021.617342:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859195776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617369:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875769859195776:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874021.617385:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788874021.617396:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788874021.617401:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859195648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617427:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875769859195648:12345-0@lo:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874021.617433:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788874021.617444:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788874021.617450:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859196160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617475:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875769859196160:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874021.617481:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788874021.617523:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875769859195648:0@lo:400:kworker.0 00010000:00080000:0.0:1788874021.617538:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5b480 x1875769859196160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874021.617549:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1875769859196160:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617559:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875769859195264:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.617568:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1875769859195776:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.617765:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859194880:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.617807:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874021.617848:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859195392:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.617871:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874021.617885:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859195904:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.617902:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874021.617922:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788874021.617928:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d347f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859195008:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.617950:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874021.617969:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859195520:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.617992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874021.618011:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3342b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859196032:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874021.618082:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195392 00000100:00100000:2.0:1788874021.618087:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195392 00000100:00100000:2.0:1788874021.618118:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195008 00000100:00100000:2.0:1788874021.618122:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195008 00000100:00100000:2.0:1788874021.618157:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788874021.618162:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859195392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618201:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859195392:12345-0@lo:400:kworker.0 Request processed in 39us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874021.618234:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788874021.618248:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788874021.618261:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859195008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618293:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875769859195008:12345-0@lo:400:kworker.0 Request processed in 34us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874021.618300:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788874021.618316:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195904 00000100:00100000:2.0:1788874021.618319:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195904 00000100:00100000:2.0:1788874021.618338:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859196032 00000100:00100000:2.0:1788874021.618341:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859196032 00000100:00100000:2.0:1788874021.618355:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788874021.618361:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d334359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859195904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618390:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d334359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875769859195904:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874021.618397:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788874021.618408:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788874021.618414:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d34412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859196032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618439:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d34412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875769859196032:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874021.618445:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788874021.618466:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195136 00000100:00100000:2.0:1788874021.618470:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195136 00000100:00100000:2.0:1788874021.618496:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859195520 00000100:00100000:2.0:1788874021.618499:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859195520 00000100:00100000:2.0:1788874021.618519:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788874021.618525:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859195136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618562:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875769859195136:12345-0@lo:400:kworker.0 Request processed in 37us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874021.618568:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788874021.618587:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788874021.618593:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859195520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618620:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d347f356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875769859195520:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874021.618627:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788874021.618666:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1875769859195008:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618692:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859195520:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618701:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1875769859196032:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618710:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1875769859195392:0@lo:400:kworker.0 00010000:00080000:2.0:1788874021.618721:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3342b5ad80 x1875769859195904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874021.618731:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3342b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1875769859195904:0@lo:400:kworker.0 00000100:00100000:2.0:1788874021.618780:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1875769859195136:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.619469:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859194880 00000100:00100000:0.0:1788874021.619477:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859194880 00000100:00100000:0.0:1788874021.619528:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788874021.619537:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3458857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:3635:x1875769859194880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.619590:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3458857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a50e61a-7558-480a-b914-36a6e76b41da+24:3635:x1875769859194880:12345-0@lo:400:kworker.0 Request processed in 54us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874021.619609:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788874021.619979:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d347f439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a50e61a-7558-480a-b914-36a6e76b41da:3635:1875769859194880:0@lo:400:kworker.0 00000100:00100000:0.0:1788874021.620314:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788874021.620330:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859196288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788874021.620378:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874021.620450:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875769859196288 00000100:00100000:1.0:1788874021.620455:0:19948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875769859196288 00000100:00100000:1.0:1788874021.620503:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788874021.620510:0:19948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3475d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859196288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788874021.620539:0:19948:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788874021.620578:0:19948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3475d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875769859196288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874021.620584:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788874021.620649:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3343b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1875769859196288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788874021.621111:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788874021.621117:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788874021.621119:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 42343 lines, 42343 kept, 0 dropped, 0 bad.